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lo   INTRODUCTION 

There  seems  little  doubt  that  texture  plays  an  important 
role  in  the  visual  perception*,   It  has  been  convincingly  argued  [60] 
that  textures  carry  information  of  use  in  object  detection  and 
recognition   Many  laboratory  studies  [18,  19,  29,  60,  80 1  have 
also  shown  that  various  types  of  textural  information  have 
measurable  effects  on  perception  of  the  depth,  slant  and  shape 
of  the  surface.   In  the  context  of  computer  vision  three  problems 
have  received  wide  attention  recently,  vizD  texture  recognition/ 
discrimination,  texture  analysis  and  texture  synthesis 0 

In  the  present  thesis  we  propose  schemes  to  deal  with 
the  problems  of  visual  texture0   These  schemes,  unlike  many 
others  which  have  been  proposed  in  the  literature,  are  sufficiently 
versatile  in  nature  and  are  adequately  adaptive  to  deal  with 
different  problems  of  texture. 

Id   Decision  Theory  Method 

This  proposed  method  is  based  on  the  principles  of 
statistical  decision  theoryQ   For  convenience  we  shall  refer 
to  this  as  the  decision  theory  method  (DTM). 

To  serve  as  an  introduction  to  this  method,  let  us 
initially  attack  the  problem  of  texture  recognition.   We  shall 
consider  a  situation  where  we  are  presented  with  a  pair  of 


families  of  visual  scenes  (digitized  images ,  of  course)  which 
differ  in  texture;  say,  those  of  malignant  and  nonmalignant 
tumor  cells.   The  problem  is  to  distinguish  and  appropriately 
label  any  member  of  these  families.   This  is  the  problem  of 
texture  recognition. 

For  this  purpose  we  define  a  template  to  extract  patterns 
from  the  scene  of  analysis,  i.e.,  the  n- tuple  of  pixels  centered 
around  each  given  positioning  of  the  template.   The  occurrence 
of  any  local  pattern  can  be  considered  as  an  'event'.   All 
possible  patterns  that  can  be  extracted  by  a  template  define 
the  universe  of  events.   With  the  help  of  samples  from  both 
texture  families  we  calculate  the  statistics  of  each  event: 
including  specifically  the  probability  of  its  occurrence  in  any 
given  family  and  the  "likelihood  ratio"  which  is  the  ratio  of 
the  probability  of  occurrence  in  one  family  to  the  other.   Using 
criteria,  which  we  shall  discuss  later  in  this  thesis,  we  extract 
two  disjoint  sets  of  patterns  (events).   The  patterns  sharing  a 
common  set  have  the  property  that  their  occurrence  in  one  family 
is  more  likely  than  in  the  other.   The  classification  of  'unseen' 
sample  (i.e.,  one  that  is  not  included  in  the  training  set)  is 
achieved  on  the  statistics  of  the  occurrences  of  patterns 
belonging  to  the  above-mentioned  sets  in  the  scene  of  analysis. 
The  thresholds  needed  for  the  classification  are  determined 
with  the  help  of  training  set.   We  have  essentially  constructed 
a  filter  by  defining  one  set  as  the  'pass  band'  of  events  and 
the  other  as  the  'stop  band'.   A  scene  of  analysis  is  classified 
by  the  statistics  of  the  events  that  fall  in  these  bands. 


Here  we  treated  one  texture  family  as  'signal'  and  the 
other  as  'non-signal'  or  'noise'  [binary  case].   In  this  context 
texture  recognition  can  be  viewed  as  the  popular  problem  encoun- 
tered in  the  signal  detection  theory.   After  the  universe  of 
events  is  defined  by  the  choice  of  a  template,  in  the  decision 
theory  method,  the  criteria  for  building  up  the  'pass  band'  and 
'stop  band'  of  events  with  the  help  of  training  set,  is  based 
on  the  statistical  decision  theory  as  applied  to  signal  detection, 

In  Chapter  5  we  illustrate  how  the  decision  theory  method 
can  be  successfully  employed  to  extract  texture  borders  even  in 
the  presence  of  noise,  and  to  discriminate  various  textural 
regions  in  a  complex  scene.   We  also  show  how  this  method  can 
be  extended  to  deal  with  scenes  which  are  both  spatially  and 
chromatically  textured. 

Starting  from  this  method  we  can  generate  a  set  of 
interval  complexes  which  act  as  texture  feature  detectors  with 
the  application  of  Internal  Covering  Theory  [49,  50].   This  is 
explained  in  detail  in  Chapter  4  after  a  brief  introduction  to 
the  Internal  Covering  Theory,  as  developed  here  at  the  University 
of  Illinois  by  Professors  Bruce  H.  McCormick  and  Richard  S. 
Michalski. 

1. 2   Time  Series  Model  for  Texture 

We  propose  here  a  method  for  the  synthesis  of  texture. 
It  is  based  on  a  model  which  treats  the  pixels  (picture  elements) 
of  a  digitized  textural  scene  as  a  two-way  seasonal  time  series. 
This  method  possesses  the  desirable  characteristic  that  the 


parameters  needed  for  synthesis  are  derived  directly  from  the 
analysis  of  the  "parent"  texture  (i.e.,  the  texture  to  be 
imitated).   With  the  help  of  well  developed  methods  in  the 
time  series  analysis  we  identify  the  process  that  generates 
the  pixels  of  the  parent  texture.   This  process  is  essentially 
a  white  noise  process  that  is  allowed  to  pass  through  several 
filters.   The  seasonality  of  the  time  series  represents  the 
orderly  repetitiveness  of  the  patterns  which  is  characteristic 
of  all  textures.   The  presence  of  white  noise  accounts  for  the 
minor  variations  in  the  repetitive  patterns  from  one  'season' 
to  another,  e.g.  ,  one  video  line  to  the  next.   Starting  from 
certain  boundary  conditions  we  'generate'  the  time  series  from 
the  known  process  which  in  essence  are  the  pixels  of  the 
synthesized  textural  scene. 

In  Chapters  6  and  7  we  illustrate  this  procedure  of 
texture  synthesis  with  examples.   We  also  show  how  the  parameters 
derived  from  the  time  series  analysis  can  help  select  the 
appropriate  size  and  shape  of  the  template  used  in  the  decision 
theory  method.   With  an  example  we  show  how  it  is  possible  to 
use  this  method  also  for  texture  discrimination. 

1.3   Linguistic  Approach 

The  world  of  textures  can  be  conveniently  subdivided 
into  two  categories:   statistical  textures  and  structural 
textures.   The  nomenclature  is  self-explanatory.   So  far  many 
authors  have  treated  these  cases  separately.   Present  methods 
suggested  to  deal  with  textures  have  been  more  suitable  to  one 


class  than  the  other.   The  methods  we  suggested  above  make  no 
such  distinctions  and  treat  both  cases  equally  efficiently. 

Textures  can  be  viewed  at  many  levels.   For  example  a 
brick-wall  texture  consists  of  a  fairly  regular  arrangement 
(structure)  of  bricks  while  individual  bricks  themselves  display 
statistical  texture.   Though  the  existence  of  many  levels  in 
texture  perception  has  been  acknowledged,  many  attempts  of 
researchers  in  the  field  have  been  limited  to  at  most  one  level 
of  textural  order. 

We  propose  a  linguistic  model  which  is  adequate  to 
treat  textures  at  many  levels.   At  any  level  it  can  either  be 
statistical  or  structural,  that  is  to  say  we  introduce  a 
grammar  that  is  capable  of  generating,  say,  brick-wall  type 
textures. 

We  at  first  attempt  to  generate  some  commonly  occurring 
textural  scenes  by  the  array  grammars,  which  have  recently 
been  introduced  by  Milgram  and  Rosenfeld  [51,  52"!  0   We  then 
extend  the  concept  of  the  stochastic  linear  grammars  to  the 
two-dimensional  grammars  in  order  to  generate  statistical 
textures.   We  note  some  inadequacies  of  the  simple  array 
grammars  to  generate  complex  textural  scenes.   By  introducing 
the  concept  of  'shape'  of  a  terminal  symbol  at  any  given  level, 
we  extend  the  simple  array  grammars  to  define  'multilevel 
array  grammars'.   Here  the  'terminal  symbols'  in  the  grammar 
at  a  higher  level  are  actually  the  'sentences'  of  a  given 
shape  generated  by  grammars  defined  at  lower  levels,  unless 


it  is  at  the  lowest  level  (i.e. ,  level  0)  in  which  case  grammar 
is  a  simple  array  grammar. 

We  further  introduce  constraints  on  the  choice  of 
•shape1  for  the  sake  of  grammatical  simplicity  and  demonstrate 
the  ability  of  the  multilevel  array  grammars  to  generate  multi- 
level textural  scenes  with  some  examples.   Later  in  Chapter  8 
we  proceed  to  show  that  in  some  real  cases,  the  'interval 
complexes'  derived  from  the  decision  theory  method  [49,  50,  64] 
help  writing  rewriting  rules  of  the  grammars  that  would  describe 
these  scenes. 

Thus  we  demonstrate  that  the  methods  we  have  suggested 
act  to  complement  one  another.   For  example,  we  start  with 
time  series  analysis  of  some  textural  scenes  in  order  to 
suggest  an  appropriate  size  and  shape  of  the  choice  of  template. 
Using  this  template,  the  decision  theory  method,  in  conjunction 
with  covering  theory,  comes  up  with  a  set  of  interval  complexes. 
With  the  help  of  these  interval  complexes  we  can  then  write 
an  array  grammar.   Thus  with  these  methods  we  can  potentially 
discriminate,  synthesize,  and  formally  describe  textural  scenes. 

1.4   Summary  of  the  Chapters 

In  Chapter  2  we  survey  the  literature  to  review  present 
strategies  for  the  analysis  and  synthesis  of  visual  texture. 
Chapters  3  and  4  are  devoted  to  the  introduction  to  the 
Decision  Theory  Method  and  Internal  Covering  Theory  respectively. 
In  Chapter  5  we  study  the  application  of  the  Decision  Theory 
Method  in  practical  cases  with  some  examples.   The  time  series 


model  is  explained  in  detail  in  Chapter  6.   The  results  of  the 
texture  synthesis  experiments  are  shown  in  Chapter  7D   Chapter  8 
is  devoted  to  the  two-dimensional  grammars  in  which  we  introduce 
the  multilevel  array  grammars.   We  present  the  summary  and 
conclusions  in  Chapter  9. 
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2.   LITERATURE  SURVEY 

2. 1   Visual  Texture 

Everyone  seems  to  understand  what  "texture"  means  as 
we  live  in  a  world  rich  in  textures.   If  viewed  at  an  appropriate 
angle,  texture  can  be  seen  in  almost  every  scene.   Yet  it  is  one 
of  those  terms  which  has  escaped  a  precise  scientific  definition. 
As  a  matter  of  fact,  the  host  of  visual  scenes  indicated  by  the 
term  texture  is  so  enormously  large  and  varied  in  nature,  it 
appears  that  it  is  a  very  difficult  task  to  span  the  varied 
concepts  of  textures  by  a  single  definition.   The  definitions 
like  "texture  is  that  property  of  material  which  indicates 
what  it  feels  like  if  touched"  and  adjectives  like  "rough," 
"smooth,"  etc.  deal  with  tactile  textures.   We  are  here 
exclusively  interested  in  visual  textures. 

Pickett  [591  observes  that  for  any  visual  scene  to  be 
seen  as  texture,  there  should  be  "a  large  number  of  elements 
(spatial  variations  in  intensity  and/or  wavelength)"  and  that 
"the  elements  and  rules  of  spacing  or  arrangement  may  be 
arbitrarily  manipulated  provided  a  characteristic  repetitiveness 
remains."   He  adds  "provided  there  is  sufficient  detail  shown 
in  a  small  enough  visual  angle,  a  characteristic  texture 
emerges  even  when  the  basic  elements  or  spacings  are  randomly 


distributed."   Thus  the  primary  attributes  of  visual  texture  are 
"many  variations"  and  "repetitive  variations." 

Almost  similar  aspects  are  found  in  other  available 
definitions.   But  even  after  a  suitable  choice  of  a  working 
definition,  there  remain  many  difficulties  inherent  in  the 
task  of  texture  extraction  technology.   Hawkins  [351  in  his 
paper  enumerates  these  in  great  detail  and  comes  to  the  con- 
clusion that  "texture  classification  may  very  well  be  one  of 
the  more  difficult  tasks  in  the  field  of  image  processing." 

Visual  texture  is  really  very  sensitive  to  external 
conditions  like  lighting  and  angle  of  view,  etc.   The  same 
scene  may  present  a  very  different  texture  even  for  slight 
modification  in  the  external  conditions.   Pictures  in  Brodatz's  [7] 
book  on  "Textures"  can  be  used  to  endorse  the  above  statement. 
To  simplify  the  already  complicated  problem,  we  assume  that  the 
scenes  with  which  we  are  concerned  are  taken  under  similar 
conditions. 

With  these  problems  and  its  prospective  applications  in 
important  fields  like  biomedical  sciences  and  remote  sensing  of 
the  environment,  texture  analysis  stands  as  an  attractive  as 
well  as  a  challenging  problem. 

2.2   Classification  of  Textures 

Textures  can  be  subdivided  into  at  least  two  categories: 
statistical  textures  and  structural  textures.   Statistical 
textures  in  a  visual  scene  can  be  regarded  as  defined  by  a  set 
of  statistics  extracted  from  a  large  ensemble  of  local  measure- 
ments made  on  the  scene.   We  need  more  information  than  this 
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to  define  a  structural  texture;  here  the  texture  is  considered 
to  be  defined  by  subpatterns  which  occur  repeatedly  within  the 
overall  pattern  according  to  well-defined  placement  rules,  as 
for  example,  wallpaper. 

Though  we  find  many  textures  which  can  be  classified 
adequately  under  one  of  these  asymptotic  categories,  there  are 
still  many  textures  for  which  a  strict  classification  may  be 
questionable. 

2.2.1   Structural  Textures 

As  its  name  suggests,  the  subpattern/placement  model  [72] 
appears  to  be  the  most  appropriate  model  to  deal  with  structural 
textures.   This  model  is  by  far  the  most  widely  used  model  in  the 
available  literature.   The  "subpattern"  is  sometimes  referred 
to  as  the  "unit  0611."   Usually,  but  not  necessarily,  the  sub- 
pattern  itself  might  contain  sub-sub  patterns  and  so  on. 

As  we  accept  this  model,  the  description  of  texture  is 
indeed  simplified  to  developing  a  language  to  describe  the  unit 
cell(s)  and  spelling  out  the  rules  of  its  placement  over  a  given 
region.   Similarly,  synthetic  generation  can  be  employed  to 
develop  the  unit  cell(s)  and  distribute  it  over  the  given  area 
according  to  (appropriate  curvilinear)  placement  rules.   The 
works  of  Trout  [89],  Conroy  [12],  and  Rosenfeld  [72]  reflect  a 
similar  treatment  of  these  problems.   Trout  attempts  a  formal 
description  of  wallpaper- type  patterns.   The  constraints  of 
the  wallpaper  design  are  liberalized  to  provide  a  formal 
description  of  texture  on  a  "generalized  wallpaper"  design. 
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He  develops  a  syntax-like  vehicle  to  describe  primitive  patterns. 
In  terms  of  these  patterns  and  appropriate  syntactic  rules,  the 
unit  cell  is  described.   The  wallpaper  pattern,  and  eventually 
more  complex  textural  patterns ,  can  be  described  effectively 
in  terms  of  these  unit  cells  and  their  distribution.   The 
success  of  this  scheme  obviously  depends  on  the  judicial  choice 
of  the  unit  cell,  primitives,  and  appropriate  syntactic  rules. 
The  crux  of  the  problem  lies  in  the  choice  of  the  above  parameters 
based  on  the  scene  of  analysis.   This  deserves  more  attention. 
Without  practical  simulation  one  cannot  decide  how  appropriate 
the  descriptive  scheme  is. 

Conroy  [121  introduces  the  notion  of  "signs,"  defining 
these  to  be  any  collection  of  lines,  usually  in  close  spatial 
proximity  to  each  other.   These  are  similar  to  Trout's 
"primitives."   Suitably  manipulating  the  composition  of  various 
signs  of  different  sizes,  Conroy  attempts  to  generate  realistic 
textures.   His  method  can  be  used  to  generate  a  unit  cell  and 
construct  the  whole  scene  by  properly  distributing  the  unit 
cell.   His  program  requires  as  an  input  the  choice  of  "signs" 
and  their  sizes,  densities,  and  appropriate  spatial  distribu- 
tions. 

Rosenfeld  and  Lipkin  [72 1  also  start  with  the  unit 
cell/placement  rule  model  for  the  synthesis  of  texture.   Various 
problems  encountered  in  this  process  have  been  neatly  explained. 
Results  are  encouraging  only  when  dealing  with  man-made  or 
artificial  textures  where  the  extraction  of  unit  cell  is  not 
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a  difficult  problem.   When  dealing  with  the  real  world,  for  the 
description  or  generation  of  natural  texture,  the  extensions 
of  the  above  methods  have  not  yielded  satisfactory  results. 

The  reason  for  the  failure  of  these  methods  when  dealing 
with  natural  textures  is  obvious.   The  extraction  of  the  holy 
unit  cell(s),  whose  size  and  shape  is  unknown,  is  a  formidable 
task.   (So  is  the  choice  of  primitives,  "signs,"  placement 
rules,  etc.  on  which  the  success  of  the  schemes  described  are 
very  much  dependent. )   This  is  the  present  impediment  when 
dealing  with  the  analysis  of  texture.   Further,  when  analyzing 
a  piece  of  texture,  even  if  one  has  successfully  extracted  a 
unit  cell,  it  is  yet  very  difficult  to  decode  the  "secret"  of 
the  placement  rules — which  demands  a  thorough  analysis  at  the 
global  level. 

2.2.2   Statistical  Textures 

Many  investigators  in  this  field  have  developed  methods 
which  are  usually  statistical  in  nature  when  working  with 
natural  textures.   Rosenfeld  et  al  have  attempted  to  discriminate 
textures  by  merely  detecting  the  differences  in  averages  of 
local  properties.   They  demonstrate  their  scheme  by  detecting 
textural  edges  using  the  gray  level  as  the  local  property  [71  ]. 

Muerle  [53]  also  uses  statistical  analysis  for  the 
discrimination  of  textures.  He  divides  the  whole  scene  of 
analysis  into  many  cells.  Starting  with  a  single  cell,  he 
expands  the  region  by  comparing  the  statistical  distributions 
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of  the  cell  with  its  neighbors  and  adding  the  new  cells  to 
fragments  which  have  similar  distributions. 

Bajcsy  [3  1  also  proceeds  in  a  similar  direction,  that 
is  by  dividing  the  region  of  analysis  into  'windows',  extracting 
'texture  descriptors'  in  each  window  and  patching  windows  which 
have  'similar'  descriptors.   Her  work  mainly  deals  with  textural 
scenes  that  occur  in  nature  (natural  textures)  like  trees, 
clouds,  water,  grass,  etc.   'Texture  descriptors'  are  evaluated 
both  in  spatial  domain  and  frequency  domain.   Directionality 
turns  out  to  be  one  of  many  useful  features  that  is  detected 
easily  in  frequency  domain.   In  fact  texture  descriptors  like, 
'homogeneous,  random,  blob-like,  mono  and  bi-directional'  are 
derived  from  fourier  analysis  of  the  scene.   Analytic  expressions 
of  spacing,  size  and  contrast  of  'texture  elements'  are  also 
derived.   The  process  of  region  growing  is  represented  by 
sheaf- theoretical  model  which  formalizes  the  operation  of 
pasting  local  structure  (over  a  window)  into  global  structure 
(over  a  region). 

Success  of  such  methods  largely  depends  on  some  crucial 
choices  like:   the  size  of  the  windows,  determination  of  the 
similarity  conditions,  etc.   Also  there  are  many  practical 
difficuties  involved  when  dealing  with  natural  textures,  say, 
for  example  determining  the  texture  element  in  a  scene  and 
computing  its  size  and  so  on.   Acknowledging  these  problems, 
Bajcsy  claims  that  some  higher  level  programs  have  been  written 
which  would  help  make  these  decisions  without  excessive  user 
interaction. 
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There  is  yet  another  approach  for  dealing  with  problems 
of  statistical  textures  as  suggested  by  Bartels  et  al  [4].   In 
this  scheme  a  digitized  textural  scene  is  regarded  as  a  two-way 
time  series.   Methods  have  been  developed  [5  1  to  determine  the 
'order  of  dependence1  in  a  two-way  time  series.   That  is  to 
say,  the  number  of  neighboring  pixels  which  influence  the  value 
of  a  given  pixel  can  be  estimated.   This  information  and  other 
relevant  stochastic  properties  extracted  from  the  time  series 
have  been  successfully  used  for  the  proper  diagnosis  of  tumor 
cells  by  Bartels  [4], 


15 


3.   DESCRIPTION  OF  THE  DECISION 
THEORY  METHOD 


When  presented  with  a  textural  scene  for  analysis,  we 
need  to  perform  the  following  tasks.   First  we  must  discriminate 
the  various  textural  regions.   This  is  the  task  of  scene 
segmentation  using  textural  information.   Later,  if  needed, 
we  may  have  to  identify  each  textural  region  with  any  one  of 
the  classes  of  textures  presented  before.   This  is  the  task 
of  texture  recognition.   The  next  in  line  is  the  more  difficult 
task :   to  analyze  each  homogenous  texture  and  try  to  extract 
significant  textural  features  from  it.   Ideally,  of  course, 
we  would  like  to  extract  minimal  information  needed,  perhaps 
to  faithfully  reconstruct  or  synthesize  the  original  texture. 
This  procedure,  when  fully  developed,  would  constitute  texture 
synthesis. 

3.1   Texture  Recognition  as  Statistical  Decision  Problem 
Texture  Recognition  can  be  basically  viewed  as  a 
statistical  decision  problem  where  ,  as  in  a  single  trial  of  a 
psychophysical  experiment,  a  cycle  begins  with  the  presentation 
of  textural  scenes  and  ends  with  the  response  of  the  decision 
maker.   The  type  of  responses  expected  of  the  decision  maker 
varies  with  the  problem.   For  example,  in  a  typical  recognition 
problem,  given  a  textural  scene  T„ ,  a  decision  is  to  be  made 
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if  it  belongs  to  T   or  T  .   Here  T   represents  a  family  of 
visual  scenes  consisting  of  a  particular  texture,  or,  one  of 
the  hypotheses.   The  alternate  is  T  which  does  not  contain 
that  particular  texture.   The  anticipated  response  here  would 
be  either  "1"  or  "0",  representing  "signal"  and  "noise" 
respectively.   This  is  the  binary  case  we  considered  in  the 
previous  chapter  and  the  decision  problem  can  be  extended  to 
a  case  with  multiple  hypotheses. 

3.2   Description  of  the  Scheme 

Ideally,  each  texture  is  composed  of  one  single  pattern, 
"the  unit  cell"  and  if  one  is  able  to  extract  it,  the  texture 
recognition  problem  would  be  reduced  to  comparing  unit  cells. 
But  as  we  have  already  discussed,  things  need  not  be  so  simple: 
More  than  one  unit  cell  may  be  present  in  a  given  scene,  the 
placement  rules  may  be  difficult  to  extract,  or  no  unit  cell 
may  be  detected. 

We  avoid  these  problems  by  defining  our  own  universe 
of  local  patterns.   We  try  to  determine  which  of  these  local 
patterns  characterize  any  given  texture.   At  this  point,  we 
use  the  elements  of  statistical  decision  theory.   In  what 
follows,  we  define  some  of  the  basic  terms  needed  for  furtner 
presentation  of  the  method. 

3.2.1   Local  Patterns  (Events) 

We  define  a  template  centered  around  a  point  which 
samples  the  patterns  from  the  scene  of  analysis.   Each  possible 


17 


pattern  is  an  n-tuple  of  gray  levels  of  the  nearest  n  neighbors 
of  the  given  point  and  is  represented  as  the  n-dimensional 
vector,  e.g.,  e  =  (x, ,  x_  ,  ...,  x  )  and  is  regarded  as  an 
"event."   All  possible  local  patterns  define  the  Universe  of 
Events,  E  .   For  example,  if  the  digital  picture  was  quantized 
to  "h"  gray  levels  and  the  sampling  template  has  n-pixels,  then 

__  TT 

there  are  h  elements  in  E  .   Figure  3.1  shows  the  number  of 
elements  in  the  universe  for  the  templates  shown. 

3.2.2   Likelihood  Ratio 

The  "events"  described  just  now  serve  as  the  local 
evidence  for  the  decision  maker  at  the  local  level.   The 
"likelihood  ratio"  of  an  event  is  a  single  number  which  is 
an  indicator  of  the  strength  of  evidence  that  the  occurrence 
of  that  particular  event  would  provide  for  the  presence  of 
the  signal.   More  precisely  it  is  the  ratio  of  the  probability 
of  the  occurrence  of  the  event  in  T   to  that  in  T  .   This  is 
estimated  from  the  "training  samples"  provided  from  both  the 
families  of  T   and  T  . 

Let  E   and  E   be  the  sets  of  events  obtained  from 
scanning  T   and  T  with  a  given  template,  respectively.   Let 

n  (e,  )  =  The  number  of  occurrences  of  event  e,  in  T 

nn(e,  )  =  The  number  of  occurrences  of  event  e,  in  T 
nT   =  The  number  of  events  in  T 
nT   =  The  number  of  events  in  T 
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P  (e,  |T  )  =  The  probability  of  occurrence  of  e,  in  T 

i.e.  ,  probability  of  e,  conditional  on  T  . 

_  nl(ek) 
nT1 

P  (e,  |T  )  is  defined  similarly. 

Then,  the  "likelihood  ratio"  of  the  event  e,  is: 
'  k 

P(e,  It1) 

LR(e  )  =  7  ^— — 

P(e  |TU) 


where  "y"    is  a  normalization  factor  which  compensates  for  the 

intrinsic  probabilities. 

The  "a  posterior  probability,"  that  is  the  probability 

of  truth  of  the  hypothesis  at  a  local  level  conditional  on  the 

occurrence  of  the  event ,  can  be  shown  to  be : 

.         LR  ( e,  ) 
P(TX|  e,  )  = 


'k'   '  l+LR(e,) 

3.2.3   Decision  Goals:   Optimal  Decision  Making 

There  are  four  outcomes  in  the  binary  signal  detection 
problem:   two  errors  and  two  correct  decisions.   A  "false  alarm" 
is  to  choose  T  when  it  is  T   and  a  "miss"  is  vice-versa..  A 
"hit"  is  a  correct  choice  of  T  ,  and  the  correct  choice  of  T 
is  known  as  a  "correct  rejection."   There  may  be  different 
values  associated  with  the  correct  decisions  and  different 
costs  associated  with  the  errors. 

There  can  be  many  alternative  decision  goals.   One  of 
the  goals,  for  instance,  is  to  maximize  the  expected  value. 
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The  "expected  value"  is  the  sum  of  the  four  terms,  each 
representing  the  value  or  cost  associated  with  an  outcome 
weighted  by  its  probability.   Other  decision  goals  could  be 
to:   maximize  a  weighted  combination,  maximize  the  percentage 
of  correct  responses,  satisfy  the  Neyman- Pearson  objective, 
and  so  on.   These  are  discussed  in  detail  by  Green  and  Swets  [28] 
and  they  prove  that  whatever  is  the  decision  goal,  the  likelihood 
ratio  criterion  is  the  optimal  decision  rule,  that  is  to  choose 
T   if  LR(e,  )  >  p  ,  where  P  is  a  positive  number.  P  may  vary  for 
each  decision  goal. 

With  this  background,  we  are  ready  to  partially  define  a 
local  categorizer  \ir   on  the  basis  of  training  set  of  information: 

R 

Let      E   =  event  space 

F1P    =    [e|  e  e  E1  U     E°    and   LR(e)   >  P} 
F°P    =    {e|  e  e  E1  U     E°   and   LR(e)    <  P) 
F*    =    {e|  e  €EU\e1  U    E°)} 
Then,    define^-,   by   its   acceptance   set   R,    i.e., 
\|r  D(e)    =   1    iff   e    e    R 

Is. 

where   F1P    <   R   <  F1P  U     F* 
and  R  fl    F°P      =  0 

Note  that  the  determination  of  which  events  in  F*  are 
in  R  has  not  been  made  at  this  point.   These  represent  the 
"don't-care"  events  and  their  assignment  will  be  deferred  until 
later. 
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3.2.4   O.C.  Curve 

The  Operating  Characteristic  (OC)  curve  (Figure  3.2) 
is  a  useful  device  for  observing  and  predicting  the  behavior 
of  these  categorizers.   To  make  the  curve,  each  event  e  e  E   U  E 
is  regarded  as  a  two-component  vector  with  x  =  p(e|T  )  and 
y  =  p(e|T  ).   An  ordering  can  be  imposed  on  these  vectors  by 
sorting  them  in  descending  order  by  the  likelihood  ratios  of 
the  e's.   The  curve  is  generated  by  placing  the  tail  of  the  first 
vector  at  the  origin  and  then  concatenating  the  rest  in  order 
(Figure  3.2a).   The  OC  displays  several  useful  items  of  information 
in  an  easy-to-see  form.   For  one  thing,  the  training-set  perfor- 
mance of  a  categorizer  for  each  value  of  P  is  shown  directly,  since 

v 
for  each  threshold,  the  y-coordinate  is  equal  to  r  iTT,,  wQi 

'  J  ^        ( e  |LR(e  )>p; 

i  1  Z         i  0 

p(e  T  )  and  the  x-coordinate  is  equal  to  r  i  T  „,  Wft->p(e  T  ). 
1  le|  LR(e ;>p j  c      ' 

The  point  on  the  OC  corresponding  to  a  given  value  of  P  is 
easy  to  find,  since  it  is  the  head  of  the  vector  with  slope  =  p*  . 
(Note  that  p"  only  has  a  discrete  number  of  values  with  different 
performance  effects. )   The  OC  also  provides  a  measure  of  the 
inherent  separability  of  the  textures  in  the  training  set.   The 
area  under  the  curve  (A )  is  equal  to  .5  if  the  textures  are  non- 
distinguishable  (all  events  occur  with  equal  probability  in 
both  textures)  and  is  equal  to  1.0  if  the  textures  are  perfectly 
distinguishable  (all  events  occur  in  one  or  the  other  texture 
but  not  both). 
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Figure  3.2a   Operating  Characteristic  Curve 
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The  OC  curve  can  be  displayed  in  another  form,  by 
plotting  it  on  probability  scales,  that  is,  on  axes  scaled 
linearly  for  normal  deviate  (Figure  3.2.b).   This  type  of 
representation  will  be  useful  when  the  density  functions  of 
the  events  extracted  from  T   and  T   are  of  certain  known  forms, 
like  Gaussian,  exponential,  etc.   The  OC  curves  will  be  straight 
lines  for  Gaussian  and  exponential  distributions.   In  such  cases 
the  measure  of  separability  can  be  specified  by  a  single 
parameter  [88].   This  measure,  unlike  A,  permits  the  recon- 
struction of  the  OC  curve  from  which  it  is  derived.   But  the 
value  of  A  has  another  property  useful  for  conceptual  purposes  , 
that  it  is  equal  to  the  percentage  of  correct  choices  that  the 
system  will  make  when  attempting  to  select  from  a  pair  of 
events ,  one  extracted  at  random  from  T   and  the  other  extracted 
at  random  from  T  ,  the  one  that  belongs  to  T   [28,  88]. 

3. 3   Coloring  the  Scene  of  Analysis  and  Classification  Scheme 

It  is  sometimes  convenient  to  have  the  following  trans- 
formation of  the  scene.   A  point  in  the  transformed  plane  is 
marked  "1"  (or  dark)  if  the  corresponding  point  in  the  scene 
of  analysis  has  an  event  in  the  acceptance  set  R.   Otherwise, 
it  is  marked  "0"  (light).   The  resultant  picture  is  the 
"colored"  image  of  the  scene  of  analysis.   An  ideal  case: 
colored  images  of  samples  of  T   would  be  all  "dark"  and  those 
from  T  would  be  all  light. 

In  practical  cases  classification  of  the  scene  would  be 
achieved  based  on  the  global  characteristics  such  as  distribution 
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of  l's  and  0*s  in  the  "colored"  scene.   The  thresholds  needed 
for  the  classification  can  be  estimated  from  training  samples. 

3.4  Multiple  Textures 

Thus  far  we  have  considered  only  binary  signal  detection 
(T   and  T  ).   The  scheme  can  be  extended  to  multiple  textures 
in  the  same  way  that  the  binary  signal  detection  is  extended  to 
that  of  M-ary  signal  detection.   When  there  are  M  different 
classes  of  textures  present  (Tn  ,  T„,  .„.,  T„ ) ,  we  need  to 

jr  1  '    2  '       '    M   ' 

calculate  at  least  M-l  "likelihood  ratios"  from  which  other 
likelihood  ratios  can  be  calculated.   Here 


P(eJT,  ) 
LR.  .   (e,  )  = 


ki  i 
ij  v"k'    7ij  P  ( e.  I  T  .  ) 


The  universe  of  events  will  be  partitioned  into  M-disjoint 
acceptance  sets.   An  event  e,  will  be  included  in  the  R.  accep- 
tance set,  iff, 

LRij(ek)  >  1    for  a11  i  ^  ^ 

In  general  for  satisfactory  results,  for  larger  M,  we 
need  a  larger  universe  of  events,  which  means  more  computation 
time. 

3. 5   Texture  Discrimination 

We  can  mark  the  various  textural  regions  in  a  composite 
scene  if  we  are  given  the  samples  of  textures  that  might  be 
present  in  it.   The  procedure  is  the  same  as  before:   extract 
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disjoint  acceptance  sets  of  events  representing  each  texture, 
"color"  the  composite  scene  with  each  set  in  a  different  "color" 
(gray  level).   Ideally,  we  end  up  with  each  textural  region 
marked  with  a  different  appropriate  "color." 

3. 6  Analysis  of  Color  Images 

Thus  far  we  have  discussed  only  black  and  white  pictures. 
In  practice  we  come  across  many  color  images.   The  spectral  (color) 
information  appears  to  be  very  valuable  and  is  used  in  many 
classificatory  schemes  involving  natural  biological  images  [95] , 
and  also  in  remote  sensing  technology  for  photo  interpretation. 
We  can  perform  the  analysis  of  color  images  using  the  decision 
theory  method  by  modifying  the  interpretation  of  the  'event'. 
Here  the  event  is  allowed  to  extract  the  spectral  information 
of  each  point  defined  in  the  template.   One  way  is  to  codify 
the  'spectral  signature'  of  each  point,  i.e.,  if  S^  is  the 
spectral  distribution  of  a  point,  the  event  extracts  the 
k- tuple  of  values  { S^,  ,  S^_ ,  ...  S^,}  where  *■  .  is  a  discrete 
frequency  in  the  visible  spectrum  and  k  is  finite.   Thus  the 
'event'  is  an  (nxk)  dimensional  vector  for  an  n-point 
neighborhood  as  defined  by  the  template.   After  defining 
the  event  in  this  manner,  we  can  proceed  with  the  decision 
theory  method  for  the  analysis  of  chromatically  textured  scenes. 
Normally  we  use  a  triplet  of  values  of  S^  for  each  point, 
corresponding  to  colors  red,  green  and  blue  in  order  to  match 
the  performance  of  human  eye.   A  set  of  intervals  derived  in 
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this  method  of  analysis  would  specify  the  allowable  band  of 
intensities  over  selected  set  of  frequencies  in  the  visible 
spectrum. 

For  extracting  the  set  of  intervals  which  act  as  texture 
feature  detectors  we  need  to  introduce  the  elements  of  interval 
covering  theory  which  is  attempted  in  Chapter  4. 
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4.   INTERVAL  COVERING  THEORY:   GENERATION 
OF  TEXTURAL  FEATURE  DETECTORS 


We  have  described  a  local  categorizer  in  the  previous 
chapter,,   In  principle  it  could  be  implemented  by  just  looking 
up  input  events  in  a  table  of  events  and  likelihood  ratios. 
However,  for  real  textures  and  useful  neighborhood  sizes,  the 
number  of  events  in  the  acceptance  set  R  could  be  too  large 
to  make  the  process  practical.   Also,  no  categorization  would 
be  performed  for  events  not  in  the  training  set.   By  applying 
some  concepts  generalized  from  switching  theory,  equivalent 
but  much  more  efficient  categorizers  can  be  generated.   This 
is  accomplished  by  a  technique  which  extends  the  switching- 
theoretic  procedures  for  minimization  of  the  disjunctive 
normal  form  of  a  switching  function. 

In  the  case  of  binary  signal  detection,  the  events 
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from  F   can  be  considered  a  "true"  set  and  those  from  F 

are  considered  a  "false"  set.   The  disjunctive  normal  form 

can  be  expressed  as  V  | . (e. )  where  |.  is  a  predicate  that  has 

output  "true"  when  the  input  is  a  particular  event,  e. ,  from 

F   ,  and  output  "false"  if  it  is  from  F   .   The  symbol  V  above 

represents  the  logical  "OR"  of  the  predicates.   Events  from  F* 

are  considered  as  don't-care  events.   McCormick  and  Michalski 

have  developed  "interval  covering  theory"  as  a  generalization 
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of  switching  theory  [50]  which  permits  the  transplantation  of 
much  of  the  minimization  machinery  already  in  existence.   In 
particular,  Michalski ' s  A  algorithm  [49]  for  generation  of 
quasi-minimal  covers  can  be  used. 

4.1  Notation 

To  explain  the  method,  it  is  necessary  to  introduce  a 
few  items  of  notation  from  [49] : 

E  is  the  event  space  as  before.   That  is,  the  set 

of  all  events 

e  =  (x, ,  x~ ,  .o.,  x  )  where  0  <  x.  <  h  -  1. 
1 '   2 '     '   n  —  i  — 

A  literal ,   i    i ,  is  the  set  of  all  events  e  e  E 
i 

whose  i-th  component  lies  between  a.  and  b. : 

aix  i  =  { ( xx  ,  x2 ,  .  c  o  ,  xn )   |   a±  <  x±  <  b±  . 

i 

An  interval  is  a  set- theoretic  product  of  literals, 

L  =  iQI    aix  bi,  I  <  [1,  2,  .oo,  n}. 
i 

The  interval  represents  a  "box"  in  hyperspace  which  includes 

all  events  between  (a,,  a»,  ...,  a  )  and  (b.  ,  b_ .  ..0,  b  ). 

±         Z  '      n        12      '   n 

Note  that  components  not  specified  by  the  interval  are  free 
to  take  on  any  integer  value  in  [0,  h-1] . 

"lft  Oft 

An  interval  cover  of  the  set  F    against  F    is  defined 

as  a  union  of  intervals,  L . ,  such  that: 

'  3  ' 

F1P  <  U  L  .  <  F1^  U  F* . 
-     3   ~ 

10 

Thus  an  interval  cover  contains  all  the  events  in  F   plus  some 

OP 
in  F* ,  but  none  in  F   .   However,  the  interval  cover  will 
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represent  this  partitioning  of  the  space  of  possible  events 
much  more  concisely  than  just  enumerating  all  the  events  in  the 
acceptance  set  for  T  .   Also,  the  interval  cover  can  classify 
events  which  were  not  in  the  training  set,  because  of  the 

inclusion  of  F*  events  in  the  "boxes."   A  quasi-minimal  cover 

o 
can  be  generated  via  the  A  algorithm,  which  we  can  only  sketch 

here. 

4. 2   Generation  of  Interval  Covers 

We  can  make  this  procedure  clear  by  means  of  a  simple 

example.   For  1-D  textures  shown  in  Figure  4.1a,  the  F   and 

OP 
F   are  shown  in  Table  1.   For  this  example,  an  interval  cover 

(a  minimal  one,  as  it  turns  out)  can  be  generated  manually  by 

means  of  a  visual  aid,  the  Generalized  Logic  Diagram  (GLD) , 

which  was  introduced  by  Michalski  [49]  (Figure  4.2).   In  the 

particular  case  when  variables  assume  only  two  values,  the  GLD 

reduces  to  a  diagram  which  resembles  a  Marquand-Veitch  diagram. 

The  GLD  is  a  representation  of  the  entire  event  space,  E:64 

18 
events  in  this  case.   To  use  it,  the  events  of  F   are  mapped 

06 
in  as  ones  and  those  of  F   as  zeros.   The  squares  left  over 

represent  F*  (don't  cares).   The  cover  is  found  by  an  iterative 

procedure  which  begins  by  picking  the  first  "one"  encountered 

in  a  TV-like  scan  of  the  GLD,  and  discovering  all  of  the 

maximal  intervals  which  include  that  "one,"  but  no  zeros 

(an  interval  "star").   One  of  these,  the  interval  including 

the  most  "ones,"  is  added  to  the  covering  set  (initially  empty). 

All  of  the  ones  included  in  the  "star"  are  temporarily  eliminated, 
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p(hit) 


0.60 


0.45 


0.30 


0.15 


RESPOND  Tt  IF  1(e)  >  .25 
RESPOND  "T"  IF  1(e)  >  1.3 

RESPOND  "T"  IF  1(e)  >1.3 


J L 


0.15     0.30     0.45     0.60     0.75     0.90  1.00 

p (false    alarms) 


Figure  4.1b   O.C.  for  Textures  Shown  in 
Figure  4.1a 


TEMPLATE     DEFINING     EVENTS  = 


X<     X2     X3 


INTERVAL      COVER 
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Lt 


XK 


1       3   0      2   2       3 

X,  X,  X, 


X  X 


NOTE:   Lower  limit  for  each  variable  is 

indicated  in  lower  right  hand  corner 
and  the  upper  limit  in  the  upper  left 
hand  corner. 


Figure  l+.lc.   Interval  Cover  for  Textures  Shown  in  Figure  U.la 
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Figure  k.2.      Generalized  Logic  Diagram  with  Interval  Covering 
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and  the  scan  of  the  GLD  is  resumed.   The  first  "one"  encountered 
is  selected,  and  the  iteration  repeats.   Eventually  all  the 
"ones"  have  been  eliminated.   If  all  "ones"  are  included  in 
the  covering  set,  then  the  cover  is  minimal.   Otherwise,  the 
cover  is  patched  up  to  include  the  neglected  events,  and  may 
not  be  minimal. 

This  procedure  was  followed  for  the  example,  and  a 
minimal  covering  using  three  intervals  resulted:   (Figure  4Dlc) 

T       2Y3   Y3      T       M    °Y2        2Y3      T       2V3    2V3 

If  these  are  used  to  form  a  categorizer  t    where  ^  (e)  =  1  for 

R  R 

e  e  R  =  L1  U  L_  U  L_ ,  then  the  event  categorization  shown  in 
Figure  4.1  results.  The  asterisks  appearing  above  Texture  1 
and  Texture  0  indicate  events  for  which  \|r   had  output  =  1.   The 

R 

subscripts  on  the  asterisks  denote  the  interval  producing  the 
"hit."   Notice  that  the  probability  of  a  hit  (19/20  =  .95)  and 
the  probability  of  a  false  alarm  (3/20  =  .15)  is  as  predicted 
by  the  OC  (Figure  4.1b)  for  the  likelihood  ratio  decision  rule 
with  P  =  1.   These  textures  could  easily  be  discriminated  by 
labeling  regions  with  hit  density  over  some  averaging  aperture 
greater  than,  say,  55%  as  Texture  1.   In  a  digital  parallel 
processor,  like  the  Illiac  Ill's  Pattern  Articulation  Unit, 
\|r  is  an  image  filter.   The  input  to  the  filter  is  a  digitized 
picture  in  several  gray  values,  and  the  output  is  a  binary 
plane  labeling  each  element  in  the  input  picture  as  to  which 
texture  the  picture  element  most  likely  belongs.   The 
application  of  simple  smoothing  or  noise-removal  algorithms 
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would  then  make  segmentation  into  texture  regions  relatively 
easy. 

4.3   Intervals  as  Textural  Feature  Detectors 

Intervals  were  achieved  as  "boxes"  into  which  events 
from  the  acceptance  set  R  were  efficiently  packed.   As  the 
events  in  the  acceptance  set  occur  more  frequently  in  T   than 
in  T  ,  the  intervals  which  are  nothing  but  groups  of  such 
events,  have  a  tendency  to  define  features  which  are  more 
likely  to  be  found  in  T   than  in  T  .   Sometimes  it  has  been 
found  in  a  practical  case  that  some  intervals  pick  up  features 
like  vertical  lines,  horizontal  lines,  herringbone  patterns, 
etc.  which  are  perceived  by  human  beings.   Some  of  the  features 
extracted  by  other  choices  of  intervals  may  be  very  poorly 
matched  for  human  perception.   Strategies  for  the  choice  of 
"good"  intervals  remains  to  date  largely  unexplored. 

These  "intervals"  can  be  treated  as  2-D  filters  which 
detect  textural  features  more  common  to  T   than  T  .   The 
normalized  "output  count"  of  the  filters  (normalized  number  of 
input  "local  patterns"  from  the  scene  of  analysis  that  fall  in 
the  "pass  band"  of  the  filter)  can  be  used  as  a  feature  vector. 
In  this  multidimensional  space,  we  will  be  dealing  with  clusters 
of  the  scenes  from  T   and  T   and  for  classification  purposes  we 
can  resort  to  any  popular  cluster  analysis  methods. 

It  may  be  noted  that  the  generation  of  "interval  covers" 
was  possible  for  the  binary  case  only.   Extension  of  this 
procedure  for  the  case  of  multiple  textures  is  reserved  for 
further  investigation. 
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5.   APPLICATION  OF  THE  DECISION  THEORY  METHOD 

5.1   Texture  Recognition 

We  illustrate  the  applicability  of  the  decision  theory 
method  to  the  problem  of  texture  recognition  with  an  example. 
Here  T   represents  a  family  of  textures  which  consist  of  grids 
of  different  sizes  with  varying  amounts  of  noise  added  (Figure 
5.1a).   Some  random  pictures  shown  in  Figure  5.1b  belong  to 
the  family,  T  .   All  these  samples  are  digitized  binary  pictures 
containing  32  x  32  pixels.   We  selected  a  3  x  2  template  to 
extract  sets  of  events  E   and  E   from  these  training  samples. 
For  convenience,  we  define  the  following  disjoint  sets  of  events 
which  are  frequently  referred  to  in  future. 

F1:   {e|e  e  E1  and  e  ft   E°] 

F°:   {e  |e  e  E°  and  e  ft   E1  } 

F^:   {e|ee   (E1  U  E°)  \  (F1  U  F°)} 
The  events  in  F   are  arranged  in  descending  order  according  to 
their  likelihood  ratios.   The  OC  curve  for  this  example  is 
shown  in  Figure  5.1c.   We  selected  P  =  1  in  order  to  maximize 

the  percentage  of  correct  responses  [28] ,  and  extracted  the 

IP       OP 
sets  F    and  F   .   As  described  in  section  3.3,  we  colored  the 

training  samples  and  calculated  the  thresholds  on  the  percentages 

of  O's  and  l's  which  enable  us  to  correctly  classify  maximum 
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Figure  5.1a  and  Figure  5.1b 
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number  of  training  samples.   Using  these  thresholds  we  attempt 
to  classify  the  test  samples  shown  in  Figure  5. Id  and  5.1e. 
The  results  of  the  classification  (Figure  5. If)  show  that  all 
samples  in  the  first  set  of  test  samples  have  been  correctly 
identified.   In  the  second  set,  we  used  grids  of  larger  sizes 
with  added  noise,  as  test  samples.   Here  too,  the  classification 
is  correct  except  in  the  presence  of  excessive  noise. 

A  similar  experiment  is  conducted  for  recognition  of 
textures  of  chromatin  samples  and  artifact  samples  from  Pap 
smears,  which  is  described  in  detail  in  [64], 

5. 2   Border  Extraction 

When  two  textured  regions  meet ,  the  events  picked  up 
along  the  border  can  be  expected  to  be  different  from  those  that 
occur  in  the  core  of  either  regions,  for  the  simple  reason 
that  they  are  made  up  from  parts  of  both  the  regions.   We  may 
say  that  the  "border  texture"  is  different  from  the  textures 
on  either  side.   We  can  use  this  fact  to  force  all  the  events 
in  the  border  into  a  set.   Later  when  this  set  is  colored,  the 
border  will  appear  distinctly. 

Let  t,  and  tn  be  the  protosamples  of  textures  present 

in  a  combined  scene  T  .   Let  us  consider  the  union  of  t..  and 

0  10       0 

tfi  as  T  .   We  proceed  as  before  and  obtain  F  ,  F  ,  and  F   sets. 

It  is  intuitively  clear  that  F   is  a  null  set  because  t,  and 

1    0  10 

tfi  are  part  of  T  .   F   contains  all  events  in  both  T   and  T  . 

F  contains  only  the  events  that  occur  in  T   exclusively,  which 
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are  nothing  but  the  border  events;  therefore,  when  we  color 
the  F   set  we  obtain  the  location  of  the  border  (Figures  5.2a 
and  5.  2b) . 


5. 3  Extraction  of  Texture  Regions 

Given  protosamples  of  textures  present  in  a  composite 
scene  we  should  be  able  to  mark  each  texture  region  separately. 
For  this  purpose  we  analyze  the  protosamples  and  extract  disjoint 
acceptance  sets  for  each  texture  as  described  in  section  3.4. 
We  then  analyze  the  composite  scene  and  mark  the  events  belonging 
to  each  acceptance  set  differently.   The  result  of  such  an  experi- 
ment on  a  composite  scene  (Figure  5.3a)  is  shown  in  Figure  5.3b. 
Here  we  notice  that  each  texture  region  is  marked  uniformly 
and  differently. 

We  repeat  this  experiment  with  natural  textures,  this 
time  using  the  protosamples  of  the  textures  of  nucleus ,  cytoplasm 
and  the  background  of  the  brain  cells.   The  result  of  'coloring1 
the  composite  scene  is  shown  in  Figure  5.4.   This  is  the  raw 
output  picture  and  it  is  possible  to  'clean'  it,  by  removing, 
for  example,  points  which  do  not  have  a  certain  number  of 
neighbors  belonging  to  same  class. 

5.4  Iteration 

IP      OP         .       . 
After  obtaining  F   and  F   for  a  given  pair  of  textures 

T   and  T  ,  if  we  go  back  and  color  the  original  scenes  as 

described  in  3.3,  we  obtain  T   and  T  .   This  output  pair  is 

more  easily  distinguishable  than  the  original  pair.   As  a 
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a-a-a-a-a-a-eaaasaasB-a-a-s-a-e- 
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«-d-«-B-8-a-aaaee8a«a-#-*-#-e-»- 
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*-•»  -a-a-M-B-aaaaaaaaa-a-a-a-a-a- 

,awjjiBjHjgjjaa-a-8-<-gW>waga„aaa 
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«-i»-tj-i«-9-«-88  89aaaea-a-a-8-e-a- 

_3UMMMMM  §r  trirgriifjgliili  i » 
B-a-a-a-B- a-«8 aasaaes-a-a-e-a-s- 

_  Mj8j«aaaeB9aaa-8-B-B-Ba8aaaaaBaBa 
«-a-9-i«-*-8-a8«aa*»aa-e-8-e-a-e- 
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^HiiMMiiaaara-t-a-aaaaaaaaaaaa 

fl-a-a-8-B-e-B8B8B888B-8-i-9-B-»- 

eaBwaaaa8Baaa-a-«-«-a.M.fftft„B 
e-u-e-a-B-a-aaaeeaaae-a-j  i-iTT-~ 
ati^MaBaBaB-a-f-a-MaaBBaaaaaa 


********  ***$******+$****  **  +  +  t  **  , 
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+  +  *■♦♦*♦  ♦♦++8  +  *+**«-+jO+ ft +  f  +  ++++*."i 

HnttUUMttMtUiH  »  +  »  +  »  +  +  ♦♦■♦* 
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»»  +  +  ♦  ♦♦♦♦♦♦J«.+  ++  +  »»){+fft<,f<,<,< 
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♦♦♦++♦♦♦  »»♦,)!«■♦  »»  +  <.»jt»..  +  ,.  H<(  «. 
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♦♦♦♦♦♦♦♦♦♦«-s«.«.«.«.<.+<.gt,.  +  ,.4.+<.<.+.ft  „ 

*********** K** ************** **m 

♦  ♦  +  ♦«.  +  ♦♦  ♦♦♦gUf«»tgt>t(MfMtM 

»♦»♦♦♦  ♦ _»*±*1«;  ♦_♦ jfjL*Jt»tJL±±±j-  t+<L+»  •< 

♦  ♦♦♦♦♦♦t*tt»tt«tWgtftft+ft  +  M((- 

**********************  ***mt,t,tll 


INPUT  PICTURE 


FILTERED  OUTPUT 
( ®  =  BOUNDARY) 


e-a-a-e-a-e- 

nam^aaaaaaa- 


a-it-a-a-a-a-a- 
aeaaaoaeaaaaa- 


aaaaa-a-a-s-a-e-a- 

a-a-a-a»em«a888i»a 


aaaaaaa-a-a-a-a-a- 

-B-a-amsauiiaa-aiii 
a-j-a-M-a-a-aaaaa'aaaa-a-a-a-a-aa 
-(taaaaaaaa-aa-a-aaa-eaaaaaaBaaaa 


-a-8-8-«-8--B 
8888888888888- 


8 8-8-8-8-88 

88888-8888888- 


9888998-9-8-9-9-9- 
9-9-9-989999999888 


aaaa-ee-B-a-a-a-i*- 

8-a-a8a8B8888888 


8-8-8-8-8-8-88 

8888898888888 


8889899-9-9-9-9-9- 
8-8-999998898888 


8-0-8-8-8-8-88 
8-9-989999999 


9-8-8-8-8-9-91 

Baaaaaeaaeeaa- 


9999989-8-8-888 -B - 
9-8-8-099999999999 


9999998-9-9-9-9-8- 
9-9-9-99-999989999 


9-9-4-8-8-8-88 
8889899988-88- 
8-8-8-8-9-8-88 
9888898988898- 


8899999-9-9 9 

8-9-9-9J9999999999 


8888888-8-8-8-8-9- 

a-a-a-aaamwweaaaa 


a^aaaaa-a-a-a-a-a- 

8-8-8-9888-8888898 

8888888-8-8-8-8-8- 


«-8-«l V-W-98 

88B98BaBaaaaa- 

— 8-B-B-9-8--B 

8888 a  a  a 999999-9-9-9-999999999999 

9-9-8-9-9-9-99 

eeaaaaaa-aaaa 


9-9-9-9-9-9-99 
99988B9li899»f 


eaaaaae-a-aaa-a-B- 

B-9-9-99888888888B 


8-9 9-9-9-99 

9999999899988- 


999999 — 9-9-9-9-9- 
9-9-9-999999999999 


9-9-9-9-9-9-99 

aaaaaaaaaaaaa- 


8899999-8-8-8-9-8- 
8-9-8-999998999999 


9999999-9-9-9-9-9- 
9-9-9-999999999998 


AS  ABOVE  WITH  NOISE 


**************  ***H*- ******  ****** 

***********«**-***************** 

**********  *»**mt-*  n*  **t**„*gH** 

-**** ***** ♦B*+*»*8*B ♦>♦♦»+++♦+♦* 
9+ ♦♦»♦»♦'>♦»»-♦  ♦♦♦♦+«)♦>  tt(t«HtM 
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— ********  ******  ****************** 
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**********. n** *************** *t$ 
************** ****************** 
******-****K**  ********** *******q 

****  n  *a* ****************  ****++^.lt 
-******************!*■*  **-******„ 
******* *****-***********a*****+ n 

***********************  ,,*.*  +  *  „t 
***************** ♦♦■>»♦»»■♦♦♦♦♦« 

*******+-***********-********++ # 
*****************************  *^.a 
****-******n *******-********* m 

**************  **************+++,! 
*** ***********  **■**************+ $ 
*************************** ****t 
************************ **_**+H 
+*************************l***tt 


FILTERED  OUTPUT 
(8  =  BOUNDARY) 


Figure  5.2a  Border  Extraction:   Example  1 
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Figure  5.3a   A  Scene  with  Multiple  Textures 
(t1,t2,t3,t4) 
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Figure   5.3b     Filtered   Image   of  Figure   5.3a 
(Each  texture   region  is  marked 
differently. ) 
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Figure    5.4 


Filtered   Image   of    the   Brain  Cells 
(The   background   cytoplasm   and   nuclei 
have    been   marked   differently. ) 
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matter  of  fact  for  an  ideal  case,  T   and  T   should  be  uniform 

'   c       c 

and  in  completely  different  colors.   When  this  is  not  the  case, 
as  it  happens  in  general,  we  can  repeat  the  whole  process 
using  the  colored  pair  as  input  pictures. 

Let  us  define  an  operator  C  which  operates  on  a  pair  of 
scenes : 

(T^T0)  %    (tV0) 
'         c '  c 

By  repeated  application  of  operator  C , 

(T1,!0)  £>  (T1  ,T°  }  j 

'  n'   n 

c    c 

we  can  go  on  iterating  until  we  obtain  a  satisfactory  separation 
in  the  output  pair  (Figure  5.5a  through  Figure  5.5e).   The 
improvement  in  OC  curve  towards  the  ideal  case  with  each  iteration 
can  be  seen  in  Figure  5.5f. 

It  is  clear  that  each  point  in  the  output  picture  is  a 
function  of  neighbors  around  a  given  point  in  the  original 
picture.   As  a  result  of  iteration,  the  points  in  the  output 
plane  depend  (maybe  weakly)  on  a  larger  and  larger  area  in  the 
original  scene.   That  is  to  say,  we  are  operating  on  the 
original  pictures  at  a  more  and  more  global  level  with  each 
iteration. 

The  test  picture  also  will  be  colored  iteratively  using 
the  results  obtained  at  each  iteration  and  can  be  subjected  to 
the  filtering  process  with  the  filters  obtained  at  the  last 
iteration  which  has  given  satisfactory  separation  of  the  applied 
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Figure    5.5c      Same   Textures    as    Shown   in   Figure    5.5a 
Scanned   at   Coarser   Resolution 
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Figure    5.5d 


"Colored"    Images    of   Textures    in   Figure    5.5c 
at   the   End   of    3rd   Iteration 
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pair.   At  this  moment  a  decision  can  be  made  as  to  which  scene 
the  test  scene  belongs. 

5.5   Interval  Complexes 

In  the  following  examples  we  have  extracted  the  interval 
complexes  with  the  help  of  the  program  written  in  PL/1  which 
implements  the  A   algorithm.   We  obtain  the  quasi-minimal  cover 
with  A   algorithm  by  the  disjoint  star  method. 

Example : 

8  interval  complexes  (2-D  filters)  obtained  with  herring- 
bone pattern  as  T   and  a  random  picture  as  T   are  shown  in 
Figure  5.6a.   The  multiple  texture  scene  used  for  analysis  is 
shown  in  Figure  5.6b.   It  contains  a  herringbone  texture  slightly 
above  the  lower  righthand  corner.   Figure  5.6e  shows  the  union 
of  the  output  of  all  eight  filters  for  the  scene  of  analysis. 
As  expected,  the  herringbone  texture  is  blocked.   Figures  5.6c 
and  5.6d  show  the  output  of  individual  filters  for  the  same 
input  scene  (Figure  5.6b).   It  can  be  seen  that  features  like 
horizontal  lines  and  vertical  lines  have  been  passed  through—thus 
it  is  demonstrated  that  some  of  these  filters  can  be  used  to 
extract/enhance  some  of  the  features  which  the  human  eye  can 
perceive. 
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Figure  5«6a   Interval  Complexes  (.2-D  Filters)  for 
T  =  Random  Texture  and  T  =  Herringbone  Pattern 
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1. 1(1.. 1111 .11., 1,1. 1.  ,.l... I,. 1,11 I B.B... •,. B..8,  .l.,B.,l,.B..S..S..S..S..S.B 
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.  .1.  .B8BS.I.I.  .|.,.,a..,B...SI I..  I.I....  Ml*.  I I...  1111.88 1.81.  .  ,.  ,  .11.  .  .1 8 8 

•  ■8 a.... a a aa.  ...a.  ..a. a.... a.  .aa.a. a... a.,  .a.. a.,  .aa.  s.aa. . .  .aaa.  aaa. a. a.  .a a.ss. . .  .aaa.a...  .a. 
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... .«..».  .1 a i.i «....»■ .a. 

.■..c.  ■..«..• •..•..•....• j....a.o a. 


'TTt'*ttfT* 
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i.i'..« «a..a..a»..a.i.a..M....ii 
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..•a.  .a...a..aa..a..aa..a..aa..a..a..aa. 
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,a..aa aa a.. a.  ..a..aa..a...a. . . 
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...la 
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a 

a 

,^ 

_ 

,a 
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.«.». 

a..,,,...*,,. 

.  .a...L 

Figure    5.6c      Output   of   One   of    the   Filters   with 
Figure    5.6b   as    Input 
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X...I aa a a 

..a... a an 
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.aaa.  ..aa a... aaaa..  .aaaa.  ..a..a..a...a..aa aa a.  .aa 

.I...II «,,,MM.,,HH a..aa a aa a...a. 


.aa...aaa....a a aa..    uaa. .  .1. . .  .aaa. .  .a.  .a a aa...aa. .. 
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Figure    5.6d      Output    of  Another   Filter    for 
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jtJti uu aa uu aa , ...  .an. .  .a.  ..nil ax a 
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.ae>HaaaMMMkUfcuuuuuuaaaB8KBHBa«Maaauuuaaaoaaa.  aaaaa.  aa aosottiNaaasaBBBBflBMaaMaBHBaRaB.aaMMaaaaM, .  .»HMMuauu<tuai!iiuaK.XK.NR«MAHO< 

.  k*. Jk.1j.4u. jj.uh.uu.ua. au.au. au.ua. aa.aa. .aaaa.  ..aa..Ba..aBM8MBaNaaaaa.aa.aaa..aaaaa..(iacaHaaaaaMa..aaaoiauaxuaaa.uaauoiflmo<naiu.. 
. ufeKkkKfc4ftta4«*aaUk«ttc0ibUkiGioKai£CBaaaMtfauBNaaaaaaaaaaaaBaflaa. aaaaa.aaaaaaa.au. .  .jaa.aaaaaBaaaHnaaRHaiEBKMkaBBkfc. .Ki*Bi.tttiii»«.KKKRt<MMK 
.  ^^MaikBMwaaauujaaMauaaMMfcBwitkiaaa«uuaa'J!Oi^aaaaMaBaaBaaaaiaaiaaagaa.ua«aMaaaa«aaMaB.aMauMBM«aaBitMBaaMMwaBMMM.MuaM.MM.  auaHUBM.KM.  .act 
.  k«.  (xu.ua.uu.au.uu.uj.aa.aa.ua.aj.aa.aa.aa.M.aBB.BBBBBaBHBBB.BMaBMBaBaBBasBB.BHaa.aaaaaaaaaaaaa.saaaaaoaaaauau.aaJiuuua.  .a. ««««». 
. Kf>*o.a*K«n bikk.fcitiuk.uu kLfiKMCtkBBifKKaaaaiaBaeMaBBMMa..  ,  aaaaa.  aaaaaaaaaa.uaoaa3aMa..jaaaoaMaauBaaMRaMBxaBHB6Bjui<M6(,.  if  bmk.  iikkkkhk. 
AU^'jtixvAMaMuuuuuuuauuuaaMHaaauHBMHiaaaaaaaaaaaa.aaaaaM. .  aaaMaaaaaaauaaaa.aBaaaaaaa.  .WB.aaHHaaBanMaaaau.MHaaaaaaaaauaMaHMKHKKK^MacK 
uk*.  j ji.au. uu.*u.ua. uu.aa.aa.ua. aa.au. aa.aa.  .aaKaaB6B.aB.BSBuaaaaBeaaMaaHaaaaMaaM.B.aa..uaaaa.naaaMaaa.  .aa.nu.  aaaujuaaaaaaR.aaaMot 
K.KKHKK«MHHuu«u«iiMtik.k.k,tittMtkKniMBCCBKXKXHaBCBMaaaaa..aaa..Maaaaaaaaaaaaaaaaaaaaaaaaaa.a..8aBaaBB...Maaaaaa.«KM.  .tue.s- *,!<.«***.  .kkkkx 
. ufcMMBau«kuu»uuujiauuuMuanBuiMBMa««aaaaaoaaaanaaaa.aaqBBMB.B8ana,  •<MaJ|*  .  aa.aBBBCtBBBBH.MBflaBBB.BB.  .aaaiiHNaaMHuMMa.aMUuMauHaKKMDtaaoi 

.  ka.  «n. uk. uu.uu.uk. ku.BH.Bu.ua. ua.aa. aa.aa.  ..aa. .  .BaaaBaaauH.MMM as.  . uuau uuuuauMaBMMaaH aaa.  .aHa.iKamc1aaauaH8.UKnaaux1x40101.uan. 

.  Ki**ftU«u*fca)tt*ti4uu»k)ttutiKBBttBBiuttiBB8BBiaa(gaH.aM.  EBRUjauuauMaa . a ftauuaaauaau . aaau . aa J . aauuaa . . .  ,h.  . .  .HXMMH.aBttaKhi4BKBKBk.ic  ,.tctKtiti.K. 
bkKK»aRMKkuuwuuuuuuuuuNaKMH8«BM8auaa«aaaaaaaaaaaaHaBa.BMBBaBBBeRBBUB.MtBB.Ba.BaBBB. .. .BRBBEitRaaaHaaMaaaaBuuuuuuuuMNRutMK..  wsunau 
uMK.».«.au.uu.u».uki.uu.Ka.BH.aH.Ba.iB,aa.aa.a«BBBBBBB...BBBaaBaB.8au89aaBaBaa.Haaaa.  .a.aaftaaBHaHHttauaNMauauMUEuuuuir.Nuu.uEKk.haHRu 
Muc<.icMKMMtKBiUu*fcauHiiiUkUkiHB»MHB»k<BBBBBBBBaaa8uaM. aaaa. aa. aaaa.  .aaMMaauaaa.iijaau.  .ajaiuauuRa.aaa.MBMaRaa. .  ««Me..«ifi*&  .  urmk  sk.»K  rick  kick  *k 
.kkkaMQiMu*?M*uuuuuujuujjaftMaBHB«aajaajajaj3aaaaaaaMa..BMBB....BBM...B.BBBMBHBBBt..tB..BBBBBBB.»caKBa<aHwa8aaua..uuMajuajiuH«M.Mao«. 
.  uix  .uu.au. au.uu.ua. BB.ttH.BB.HB.Kk  .fB.MK.MB.t.aaBBHHUB.HBaaaH. .  aacjuua. .  .cnauua.ua.  .aaa.  .uu.uuaa.aMauaaaauu.  .muuukujk.uuumkmki'.mik..  kk 
.uhu«MaNuauuuuuau«uHaBMBMMaBHK8BMHaauaHaiaH8a8.aaaaaBuaBauBaaaaaB.a..a.  .  aaaaa  waaaau  j.  aaaaaaasauRatauMR  m.  wMkaa.  uu  j.  *uu.  s»»hk«i(«*!. 
.  kJkkkfiKkkkSuuuajuuuuaMNkHaauRaauaaaautiaaaauiiaaaaaHaaaaaBauHa.BnBBBBBBB.BBBMRauBB.aBUNGN .  .BaaBaaicHix MHMMBKSUu.ua..  uaauanuaanana. 
. uu.au.  uu.uu.4j.ua. bu.ub.hb. lb. aa.ca.aa.aa.  .aaaaa.HaBacaaBHaa.aaaaaa.aaaaa.aaaaaa. .aaaaaa.aaaaaa.  ..an.  .uaauuaaftu*.  bi.uh.fticw.  .rm.hr 
.RauKUuMMHauftfcftJiu>aKuakiMBBMBBBBHaHHBaHaB8aa.auaHHBMaaaBBBeaMaaaB.aaa. .  .aaa. ..  .aaaaaaaaaa. . .  .auaH.aMa  .aaa.  .huuhr.  . .  mb.rr.  .rmkmhkk 
.  i*itBKi«aau.juuuuaauua«a«uaa««aaaaajjaaajaciQaa.jaaaaaB..aa..MH..8BMfl8..BBa.BBfl«aBic.BBHB8B.iCRaBBtKBHauaac<a.aaiuuaaMu.  .a«aanaaaaaa 
ku.  . muuu.  ..a u *  , . .  .kk.Mk Kt.xa.iakKCBcuBMuHMaB.BauHaaaaaafla..  .au..  aaa.aaaaaauMaauuauuM.  ...aaaauaauuuaBNtifcuH.uui.KHNakKM 

Kfc.  .  «MUB*.UU4.««Jk>.B.  ,*Kk.  .  B0RBBM  .HU.H.  -  HH0U  .  8U  .  .  UaOUUM  .  BaRiKIN  fl.  a  a  .  ,  .  .  J  MUOQia  .  JMaaaaaR  JjaHMS9«aaa KaBMHRMUM.  .  .  MUAUMKRCKKKMICRK 

iKkkUkKkKkdtkU.uuuauu. . .  aa. . auuaauaauu. u.  .a.aaauuaaa.auRsaMMaa.  .a.  .h.  .mbumrrm.  .u.HaMB.RGVBc&att.KaBBBEMBHuaM.uaKuaauu. . .  Jtaaa  aaaaa. 
uu.aaiKUKau.uuuuuuuauBb. . .  .  UE>GXj»aEk.8UEK. . .  .aiiLBBfiaa, . aaaaaaaa aaaaaaaaaa lau..  au.aaaatiua.  .aaaaua.  .auuRuu.au.  jUKuuak&Ki.  .^kkuomkumm. 
jMCMf&BKjfttautf**.  .SibfcrtU.  B.KUHkhBHHMB.H.aaitaa.uaua.HajiuaaaaRaBaHBBaaaaaa.aia. . .  .naaaHanaanaHaaua.  .Ma»«nMRBMRAJ8M*UK.  x»MKMSMRKK.HaK 

K.k»KkEMUUfcUUJJk.  .afcimaBU.  kUUJUaaaauaUUUUU^JJJfflaauUUUMM.a^uMgBHMBB.gMB.BB.BH.KBKB.BMMBBaM.gHBBMHR.KRM.  k«KMRKMxa.K«U.  UUUSX  HJ(4W».MU)I 

auuanjauuhuuauuuu.uuuuitahkBttK-kHUBBUBictkiaKu. . .BcaKRBUBaaBBCBBRacBBaas.uaujaui. .  .uaau.aaJaaaoaaaaanaau.iiauuaaauuuuMu.u^Bk. rhkhbhkb. 

RkKkkietK.  .auuuua...auaaatcHBBHMBa.aaBa.  .aa.Haaauaaauj.aaaaaaaa.aflBBMHaaaHBBaaaaBuas.BBaKaacHHB.BHR.HauHHaaBauuM ukmkmmrrmrs. 

K.kKktfkHkuajuuuuuuuuuj.uhBaa.  k.  .  ks.uuuaiauujua.  .aauauaaa.aaaa.  aaaa.eBaHHaaa.BBHBaK.Baaaaa.  .nsaHBKBaRSRMNHRUjaaua.^u.aaHiKKMnak'NR 

.  .  .  Ug.UUuaUUUUUUUUUUU.  .  .kKU..  .BBttH.MB.K.  .  .  k  .  IKHBUEUHMHRHBBUXHHMflBU  KMaCJCi!  JUaU  .  SU'XiaajlJ  J  JR  JiJfl  JlUU.  .  .  MUSlOliI  uaaaflUUJJ  X  A  .  .  ttfctiK  .  SW.  RRBBBH 

ukKia>kKikkkk»«utiB.u*uB«Bk«aBKHBMMH.aaaaBB.  .uaaa.oauuaaaaaaaaB.aaBaa. .  .MHaBBMBHH.fittBflUMKta.uuxc.  .B.KtRRKHKK&u.uuM. .  .  .uksdxxk.rmgiw 
u.wMKit... . auaaua. aaaa. mb., aaaa «aa..uf  itia B.ai.gB. MMuaaaaaaaa Baa 8BBBBBB6B.ua. aaaaMBaoiaaH.aB.  .BRBB.iriRMfSM«a..uuf  .uaa.a.  .ba.»KM..R9(K 

.  .uuauu..uuuuuuJuuuau.uHk.uBKUMBHRicttioiCk:.  ..tin.CBtiMHHuaMN.ti&i!HBk;e»H. .  .a ju.j.  .uaanct..aaaaaanjaii'xauu.  .auuKaua<s«.  .K.tkMHHRHBKR 

.  .K(ikKaxkkkk«.kikiHuaBBKiCBa.  .BBMMauaaaaaa.Haau. . . .  aaaaa.aa(iuaaa.MRaa.NaBBuaaatt.aB.BttBfinkiK)VK)ntHE.HK.  KRKicHkRu.KRCRfcjiCNMhJtRMR.MMMMR 

Ui&hKktoiaMRauu.uu.auu.uuaauu..  BUMBMBaauau.jaaaaaa. . auaaaaM. aaaa aaKHHaaaaa. sua.  .RaeuuaMflBBMRR rrh.  .anHflaauaanuajuuRHRUM.  .hmhuu 

u.uiuRaaauau.  ..uu.  .uauuHaflKMBNHB.nBBBB.BaeuK.  .aaBB.BuaBBBBERKBuaaaaMasuaaaauaaa.aaauaaaaaaa.aflainau.  .'iciuauuauuuM.  .xuaukKss.  .kkkrx 

K.aiiikB.KBk..  .auuauuaa.fcaBaHHHBBMBaBHBaaaaa.a.aaa aauauauuaaauHBauaaflHHBaBBflBHMUu.  .BBRBBfiatKCBCKRHRRKN.BiiiuuuuaauKMRM.  kh.mm. 

.  .*.a«uiHKBuu4*u.uuuuu. . aMBBaau .aa. kaaaaaiaaajaaoaaa .aa. . aa . mm.  aBMaaa.aB.jRHBBHRaMa.au.  .sbmh.  .  .BaHBMHKflRaaaaaau.  ajtHaa.axflji.  xcuak* 
. . . uajuauaaauaaa. .uauHUBKH. brhbrb. .Bfiacc.Bcaac. .aa. .a. . . .ca. .BaBHRaa.aaaiB.aaujaaaauaa.aaa. .a.aa. . .jja.uaa, .anuaaaBKBaBR.kKRRne. 
. . xcif  KBBK.gutik.BMiiK.BiccKaactiBBBB.aattaBH.aflasjaB. . .  aaaaaaaRaaauHaaBMBaauaBBBHBBBaBBBBOccioioaKBBaBB.  .BaEKMaE.aBBBUBRaMaaRiiRR.  rmbrm 
uuMuak.Haaauu. .uuau. . .uaanaaau.aH.taHaacaaaaaaRaKaKa.BBCM. .aa.BaH8HHBaaaaaaa.aaRRBu.uBR.HR«KB.aaR. .  .naaaa. , . .uu. iiauu. sxmc.  .rrmh 

NiKUM«auauuajuuuuuuuua«,k;.BattBBBHBBBBB8BieBBaauaBBrtB8BMB..  .aaB..BBBBaaaaaaaaaaaaaB «. 

K.k,kBiti)(KkJkHk«fcftuukkH.Hk>BkkHBB.HMaaBHBaMaauajaaaaaajiaauauaa.uaaa.uaaaaaa.aH.BHMaaaau a. 

jjaBu«jkaiauauuuluuuuJUjaj.aaaattaaaaaBM<ta»aa..JaaaauuHB.kM»tttBk.K.HMMBMuisiia.BgMaRa«. 

LUkkknkNaattUJAUUUU.UUHBHkHBkl.  BtiBHBBkBKHBia.lKUaBHMRUUauaUHM.HHaM.HMa  .UuUUUUR.  .  .  .  JUJ  . 

kKHNiiafiHh.k'kKtfai.uutkuuuuKKkKHBuuaBMCMkB^asRaaaa. .  .aauuua.aaaaaaajjaa.aa.auaaaaa.  .a.  .aa «a 

uuBaasBiHaoiuuuuuuauuuuuuauauuaanMaauHuuuBk'HHkHBBBBBH.HaBMH.BUBttaK.SBBcaa.aBBa.  ..u» aa 

aktfHk<KkJkJfckk*u«HUHKkfcaBKUk'ttaBfcMB88HitM.  its  kbmrbu  .  BMSua aa  .aaa.  Bauaaaanaa.  .uuauu. .  .  .UUUU BR 

KRf.aiaiHKKHa*a»uutfUKuaaR«HaaaaaaaaaaaMaBC.aaaaB.aanfla..aaHRaaaitRsa.aa..auaaaaaaaHaMB aa 

.  ««KkfluaMugaa.uuuuuuuujaBajaaaaMBauaaaaBBMaMaaa.B.tMBaBMBB.MBBMMHHH.BBMtt.MBMBB..MB8aaa aa 

uaMaoiHkUHKBBkk.tiBBibBKukttKtBcaHi(iac.CKtiH«iCBk-H. .  .aaaMauaauuaRHMflutiaaaauau.ujaiftxujiaai 

.  Kka.kKBHkKuauuuuuuauauaocaaaHaaaaaaauaaaaaH. .  .uaauuRaaaaaHKuaaas«atiHBCk.  .uaaBtaaaaH a. 

.  jkaauauuBauuuuautijuuusaaciuauuuaAMuaauttMaaa.aaRUMaa.  .BBBa.aau.  aMaaHHaaBRaMHaaaaaaa rr 

uaKM.BHaBiLBBBCfcfcaBkikkBBKkuHHRkaHMCk'KSBsaiCKaHia  .aaauH .uaaa . aa.  MaaaauaaauaauaaJiaijau t. 

RHKRiHiBHBaau.u.uuuajauaotttuaaciaugaauaaajaaaa.aaBaMua.uaauBaBBkiBCHfluHaRaaJMBKCBtBB.Ba a. 

■  uR.aaaaBBaauuauuBu.a^afl^au^aaMRiaaMM^tiaJajaajiBjjMjiMB^^^aji. ...  aaaaaaaaaa. aaaaaauaa aa 

.aHaaB«aHaaaBfc«BBB«fcttBB.kNH«kMMaaaaBBaBBiaHia«HBaaaauua.aa.«ciuaoiuau.  .uaoiaaaa.ciauaajia an 

. uk  .  kKkGBCHBftkiuuua.uuduaMaa.aaaaaa.aauaaaafl.aua,  .aaaaa. . .  .a.  .aa«RB.  .bbbbb.okbbibbbbb aa 

aaauaaaaaauj.u.uaMUkJk.KaMNaauaaKiKBCa.BiBaaaaaa. .  .uua.aaaaau. aaaaa. aaauaaaa...auaaa bm 

uBuaftiiaBKkuuKHHH.fc.BUHflafiaHHuaaHURHaaaaaifaaaaaBHK.  .auBaaa.aa.uuaauaaaaaaaaa.aa.aa.j.. an 

iCKkBk«fBfiKagiaufcHuMu<UK.aKMaaaaaaoaaaaaaaaaeaaaMM.  .auaaunaa.  .HaBRBBMBBBHBBCBttBBKBB.  .a a. 

aau.ugautau^MuuaitfkUji&ikjLCjttiia^^  

aaBM»KkUHi>)H.ufcauuuHB«.BaKHaBBaaaaBa.u.  jaitaB8UM(saBuuau.auH.aaa . .  aaaaua  juuau  .aaaaiiua aa 

tKaaaaiBitauRUifkt.u.ujuaHutiaaMuaaaajjaauaa.s.  uaaaaa.auuHaaaaa.uauM.  .8Bbb8biibbh  .cbobbbbb aa 

aaauaujauuuuuuuuaaBuu.MBUkk-uNaaauBKHauKBBuufs.Ka.HuaflM.ajauauaaa.MBaauauaaaa.auaajuu kh 

HKteaBi.iiaBHfcbfcBti.hBaaBBBi.BBCBa.aauauaaaa.aBk.aaaB.Naaaaaaaaaaa.aaaaaaBaB.  .HB.aMaaia aa 

a8btfta.ciM.kuK««uaau.Baauaaaaaaaaa.a.aaaaaaa.aaaaaaaaa.aoaa.aauRBaBBBH.BMHK. .  .hbbb .b aa 

iCTHjaaaaaauuuuuauu.iUJuHafcMpaaaiiBBaBKM.a.aBi.Bi;ai;ik3atlttainii<aaaMuaaB..  ^aaauttauaaaaua mm 

tcMkHaK«BBRk.tik<fcB«uHBBuauaKaaB8BaBBHa.aaHaaHM.  .aanacH. aaaaaaaaaa. uaun a. auaaaaaaHBaua 

aauapaaHBBuBuauuuHHkuKuaaaaaa.aaaaauuJu.uuaaaaaaBauaa.aaaaaiaaHaaBHtt.HBaaB.BRBuuH aa 

uuuRsaaauujiuuauuuuuBuuBaKUMBHMRfla.aaaeaBEBU.iEfiBBB. . .BficaH.HKHaaaaaa... aaaaa. aa a« 

uBfk>tiB«Kk-kttikifr*«Uk.klk*«uattaHaBiiuaaMaaa*aaaaHa8ua. .  .aaaa aaajiaaaa. .  auaaiiwa.  tenia »mb rr 

uaauaaaauauuduauaaaauaaaaaBaaaaauaMauajataagaiaaaaaaaaa.  .aaaaa aaaaaaaMaBaaaB.  aaaaa br 

aaujjajuua.u.uuuuMuauaHHBMBaH,MaaaiBaaaiaiiaati  taBBHi^atktiSjattiagtjjjta^  L aa 

aauxkBMk.KiktkUfcUi'KBkdKaaaaBMkHMaaaaauuaaaMBaaua.aauauuuu.  .jji.uu aauaaMHBHBBBH a. 

aaa  Jaaaaaauuuduuauuaaaaaaaa. aaaaa  acaajaiiau  18 1KB  tKHMaaaaaaaaaasjuaa.aBu.HKBaaBRaa.aa r. 

uouauaaauuuuuuuuuuuHUHUBkBHaaHBBHaMaaaMKaBHKMBHk. .  .HHRHHasau.  .aaaauB.. .  .a.,  .aaaaaaaaa bh 

KKb8ffcaaBEKttfci,tii.k>k.B.k'BHBKRcaaiiHBa«MvaacaaaM«aaaauaa.aaanaaa..aaaaaaa..a.aHaaHBHaBH 

Huaujaaauauuu.u.uuuuuuuauRBaaaaaaauBtfauaiaaaaK. .  .uuuuaaaa.  .aaa aaa  .HRaaaMBflHHBHa.aMMB a. 

uuuuuJauaMuuuuuuuuu.j.uHat.ttHMimaHajfliaMUjiMmiHiHKHBBh.auaMaa.BBkuaMMMBHHaaMUBaaaaajaiDJiaa ,.*,.^ aa 

k.RBkMCSk,XHfcfc««kki«k.k<kicukkRHa.H.H«aaauaa«MBH88aaea«.ajaaaaaajajaaauuaa.  .ajMaaaHHaRHMa 

aaaa aaaaaaauauuauu.aaaaaBiHaaaauaaa. aaaaa va,ataBBf aaaa. aaaa.  .a.  ..aaeBBHMBBBBBBBBBBBfla aa 

uuujaaauaMjuuuuuu. .  uuHaaMMuaMaaB.  ..aaaaHa.  .aa.aBaBaaaHRBBHUHH.  .uaaaaaBUBuaaaaaHuaaiiBau.Aaaa ua.Jiiafl.aauaua.auRa. . .  .ur.mmhuhr 

rrkhk.  .HBCMB.BiiakiBBB.kL'Hi'Bkaacaa.aca.MaaflaaBaa. .  .auuuaa.  .ai.aauaaaaau. .  ujhr0.hkbbbcbb.  .  .bbb.bbmhh.  .BBHR.cacBBHBtBk,BBBax(BKaRREa. 

mm. jaaaaa.aauuaaaauuuuH«iaaMa.aaaRaaMaBaHBBasa. .aaaiBBBECRBERK.aBaBBaauaaaaa. .MaBHRBBaR au.aaaajjaauRRaauaH.jxaaua .aa. .aaaa. 

ah.  kiftaMMMk-uufc«uuM.,^uaauaMMHBaaB.BMMMMMBUHaaaHk)fl.BMBHaBMaMaHM.aa.aaMUM&i.aMMaB aaaaa.  aaaaaMuagaaa  .aaaBaauu.auuuauaaoi ..  .rbhrm. 

hicaBEiiiBkKaauuujaBattuaBE.cCMibKRaa.kaaaaaaacjaaaHaaaaaaaaaa.ajdauaa.jaaaaaaB.MBaaBBBB.BacBBBaHBaMRBBH.  .aM.aaaaaHaB..BBBB«KHrRa.«.. 

sa.auuu.uuu.. uuua.^u. aaauaaaaaaaaa.ua 8B8B. . .BBatBBa.aB.BaHB SB, . ..(BBaaBBB,aaaaaanaaauMaaaaa..a.aa aau.  uu..  aaa. rsor aaaaa. 

. .a. .ai«aBMkUtikuakHBUHBiau.aMau.aaaa.a..aaaaaaB.BBaaBaaa.uaaaaaaaaaanaaajaaaaaa. .aaaaaatiBHaa.ixaHaa. . .kMBEEaa.BBHk.auaaMnaaMR. .«« 
HHBRB.ift.Bk.BaaaaaBaM. .  .RKBaRvaRRCjacu.iaaaaaiP.BMfaaaataaaaaaaaaaaaaaaaaaaa. ..aaaBBaHaBHHHHHHaBaa. .BBHNaBHaaB.aaaaBBE.BM.BaaM.. 
.oiuuaaa.. ,  .auuua. uuau.. aioaaMaaaaaaauaaaaaHaaB. . .BBBCc.BHBBCBiciBcaccDCHBa. aaaa..  .aaaaaaaaaaaaaa.aaaaaa.aaaauaaaauaaaaa.  iRRMRaaa. 
K.kCKCkt. .auuu^u.u>.kMMiii(BBMicMBaBaM.aBaHaaa..aaB.aBaMaaaBaMaaaaaaaaaa..  .aa.aa..B.aaaBBBBBaB..aB.B.PB.a«.aBBuBicHB..  hhebebcbmrrmh. 

KHHBiia.HB.aBHuaaauaauBBMkKBEBBaBaaaaa.a.aaaaaaaaBBaaaaeaaCBiaaiaaiaaa. .au.aa.aBBBB.BBaBBaaBHaaaBB..aKBR.. .aaaa bbbm.  ..mm. aaa 

bmmbuuu. .auj.uuMiuuuuuuak, . . ,a. , .aauuaa. aHafaaBaBBBB.BBB8a6aB.EB. .BHaa.H..aB.aaBEB.aaaaaaBBaaauaa(iaauaaj. .aaiauua.  .aaa. ...aa..nM 

RHKMaiiHKHBKKBakiBBuajBBBH.aBM.aaB.BaBaaaaaaa aaaaBaaaaaaaaaaaaa.aaaaaaaa...  .aaaaaBaB.aBBaBafeBBRBBEB.BBJu.aauku.aBJiRHaRaMRM. 

.  sua 91 fakMuauaua.  aaaa. REk.BaHaccaaEa, aaaa. a aaaaa. aaaaaaaaaaaaaajaaaaaauauaaHBB.. .aaaaBBBBaBBaBH. .BHataaaHHajaM. ..BB.BBEREEuMaM. . 
.Muuaaa..  aa.au.  .uuu. .  .aHanaaaaaaa.aaaaaaa. . .aaac. . bbbbbbbbbh facBaucae.ua. aaaaa. aaaaaaaaaaaaa. ..uRaaaaaaa. .aujuauaa. . aaa rjr aaaaa. 
BBflaaaaHB.  kk.*fcuHkH. . .  .BkMBBMaaataaMHMaaaMBflBBMaa.MMBBBHaaRa..aaaaaaq.ajaajaaatf . . .aBaaaaaaBBa. aaa. aaaa awa. . . .HBCBuaaaMaaaaaauaB 

HiHaaHa uuHuu.uB..aaK8H.B6aB.RH.Eaaaaa.  ..aaa.  .a.  a  aaaaa.  .lia.aaaauauuauR.ttHa.BB. . .  aan88BRa.au  rmmhu]i8«uh«.uuu  a  uas.  a  BkRctHNuuRn. . 

aaaaaaaa.aaaduuauauuu.jaaaa.aaaaaaaaiaBaiaBa.fBBaBBa, * .aa.8aBaaaaa.aaciBBBaBaBaaB..a. .aaaaaua.aaaMasiaaAaaaaaa. ajjaujaaaaRsaaaaa. 

■  «»*ii.  . .  .BaB.4aait(«KfE.BHBH.BtacaaaBaHBaua8aa6BHaBaaauuaaaaauaaaaaaaaaaauaaaaaeaaaaaBBaHaBB.HBHBa.BBK..EBJak..  tBk.HB8BB.EBiaEia. 
ua. aaa... a.  aaa. uaaaauBBaaRBBOB. aaaaa. aaa, aaaaaaaaaaHaaaaaEa aaa aaaa. aHaaaaaa.8BBaa.HB..aBaBBBaaBaBB. . .a a. .aaa..Maak\HaascftaaBMuaaa 
kBuko.aaaau.Juuaauauuaaauu.aa. ..aaaaaaaaaa. aaa. HaBBBBBBBaBBaaBaaHaaaBHuaaaaHBa. aaa asa.. aaaaaaaaaa. aaRaaa.acuaaiaajauaaiRRa  a.  aaaa 
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Figure    5.6e      Union   of   the    Output    of    all    the    8   Filters    f0r 
the    Input    Scene    shown   in   Figure    5.6b 
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6.   TIME  SERIES  MODEL  FOR  TEXTURE  SYNTHESIS 

6. 1  Texture  Synthesis :   Its  Importance 

The  synthesis  of  natural  looking  textures  deserves 
considerably  more  attention  than  it  has  received.   General 
methods  are  needed  by  which  we  can  generate  a  scene  that  bears 
an  acceptable  resemblance  to  the  texture  to  be  imitated  ('parent' 
texture ) o   It  is  highly  desirable  that  the  parameters  required 
for  the  synthesis  are  derived  automatically  from  the  analysis 
of  the  'parent'  texture. 

Texture  synthesis  procedures  of  this  type  can  be  evolved 
to  solve  the  ever-pressing  problem  of  image  storage.   For  it 
requires  considerably  less  storage  to  save  a  few  parameters 
and  boundary  conditions  than  to  store  a  complete  digitized  scene. 
This  effectively  means  redundancy  in  the  image  has  been  reduced, 
leading  to  a  more  efficient  analysis  of  the  resultant  scene. 
Using  the  values  of  the  texture  parameters  as  features  for 
discrimination/recognition  is  also  suggested.   By  specifying 
intervals  on  values  of  each  parameter,  we  can  potentially 
generate  a  family  of  textures. 

6. 2  Seasonal  Time  Series  Model  for  Texture 

Many  authors  have  suggested  methods  for  texture 
synthesis  [12,  22,  24,  38,  57,  58,  72l .   Among  them  only 
Rosenfeld  et  al  [72]  and  Conroy  [12]  attempt  to  synthesize 
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natural  looking  textures  while  others  merely  generate  scenes 
with  prespecified  statistical  properties  to  be  used  in  their 
experiments  concerning  the  visual  perception  of  texture.   How- 
ever none  of  these  methods  possess  a  desirable  quality,  namely 
the  choice  of  parameters  needed  for  synthesis  be  based  on  the 
analysis  of  'parent'  texture.   We  suggest  a  scheme  for  the 
synthesis  of  texture  that  has  this  property.   This  scheme  is 
based  on  a  model  that  views  the  pixels  of  a  digitized  two- 
dimensional  textural  scene  as  a  two-way  seasonal  time  series. 
Any  digitized  visual  scene  can  be  viewed  as  a  two-way 
time  series.   Bartels  et  al  [4]  were  among  the  first  to  treat 
a  textural  scene  as  ordinary  two-way  time  series.   However  the 
orderly  repetitiveness  of  a  subpattern  which  is  an  essential 
characteristic  of  texture  strongly  hints  at  the  possible 
representation  of  a  digitized  textural  scene  by  Seasonal  Time 
Series.   The  choice  seems  quite  natural  and  very  appropriate 
because  there  is  a  striking  correspondence  between  some  of  the 
problems  that  occur  in  textures  and  those  that  are  considered 
in  seasonal  time  series  analysis.   For  example,  in  TV  scan  of 
a  texture  the  repeating  subpattern  is  not  necessaraly  identical 
from  line  to  line  though  it  retains  similar  characteristics. 
In  the  time  series  analysis  the  minor  variations  of  the  function 
from  one  season  to  another  is  accounted  for,  by  the  assumption 

of  the  presence  of  white  noise.   Well  developed  methods  are 

2 
available  to  estimate  the  values  of  the  parameters  [u   ,  o   }  of 

this  noise. 
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It  is  possible  that  there  can  be  more  than  one  periodicity 
present  in  the  textural  scene,  such  as,  the  subpatterns  consisting 
of  sub- subpatterns  and  so  on.   This  may  be  treated  as  multiple 
seasonality.   In  the  case  of  statistical  textures  these  latter 
periodicities  may  be  absent  and  they  may  be  treated  as  an 
ordinary  time  series  with  no  seasonal  effect. 

Spectral  analysis,  in  the  frequency-domain,  comprises 
one  class  of  techniques  for  time  series  analysis.   Our  interest 
here  is  to  stay  in  the  time-domain  and  build  stochastic  models 
for  time  series.   This  way  we  can  gain  a  better  insight  into 
the  nature  of  the  system  that  generates  the  time  series.   The 
models  developed  then  can  be  used  to  obtain  forecasts  of  the 
future  values  of  the  time  series.   Our  objective,  from  the 
engineering  viewpoint  is  to  obtain  models  that  possess  maximum 
simplicity  and  the  minimum  number  of  parameters  consonant  with 
representational  adequacy.   Precisely  the  same  approach  is 
taken  by  Box  and  Jenkins  while  dealing  with  this  subject  in 
their  book  "Time  Series  Analysis  -  Forecasting  and  Control" 
(Holden-Day,  1970)  [6]. 

6. 3   Stochastic  Models  for  Time  Series 

Let  us  introduce  some  notation  for  convenience  in 
representation.   Let 


. .,  Zt_2»  Zt-1'  Zt'  Zt+1'  '•• 

be  the  time  series  which  can  be  denoted  as  [Z^ 

t 
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A  series  of  values  ' a . '  ("shocks")  are  assumed  to  be 

2 

generated  from  white  noise  process  with  mean  '0'  and  variance  cr  , 

cL 

B  is  the  'Backward  Shift  Operator'  such  that 

BZ,.  «  Z.  ,  ;    hence  BmZ.,_  =  Z^ 
t     t-1'  t     t-m 

V  is  the  'Backward  Difference  Operator'  such  that 
V  Zt  =  Zt  -  Zt_1  =  (1-B)  Zt 
V1"  Zt  =  (1-B)m  Zt 
6.3.1   Non-Seasonal  Time  Series 


Box  and  Jenkins  [6]  represent  the  process  that  generates 
the  non-seasonal  time  series  [ Z . ]  by  the  following  model: 

0  (B)  Vd  Z.  =  6     (B)  a.  (6-1) 

p         t     q      t 

Where  $  (B)  and  G    (B)  are  polynomials  in  B  of  order  p 
p  q 

and  q  and  are  known  as  • autoregressive  (AR)  operator1  of  order  p 
and  'moving  average  (MA)  operator'  of  order  q  respectively.   The 
process  is  known  as  ARIMA  (autoregressive  integrated  moving 
average)  process  of  order  (p,d,q).   This  model  is  sufficiently 
powerful  to  represent  time  series  which  show  both  stationary* 
(d=0)  and  non-stationary**  behavior. 


* 
The  process  that  generates  'stationary'  time  series  is  assumed 

to  be  in  equilibrium  about  a  constant  mean  level. 

** 
Only  homogeneous  nonstationary  behavior  which  calls  for  the 

^th  difference  of  the  series  to  be  stationary  has  been 

considered. 
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There  are  (p+q+2)  unknown  parameters  to  be  estimated 
from  the  data. 

It  can  be  seen  that  the  ARIMA  process  may  be  generated 
from  white  noise  a.  by  means  of  three  filtering  operations  as 
shown  in  Figure  6.1. 

6.3.2   Seasonal  Time  Series 

In  the  same  manner  if  [Z  ]  shows  seasonal  behavior 
(with  period  s),  it  can  be  represented  by  the  following 
multiplicative  model  [6] : 

0  (B)  0  (BS)  VdV°  Z^  =  6     (B)  9n(BS)  a.  (6-2) 

p      P  s   t     q      Q       t 

s  s  s 

where  <J>  (B  )  and  0n(B  )  are  polynomials  in  B   of  order  p  and  Q 

respectively  and  V   is  the  seasonal  backward  difference  operator 

(1-BS). 

This  modified  version  of  ARIMA  process  is  said  to  be  of  the 
order  (p,d ,q)x(P ,D ,Q)  .   This  multiplicative  model  is  very 
useful  in  that  it  can  be  easily  extended  to  take  care  of  multiple 
seasonalities. 

Box  and  Jenkins  [6]  and  Bacon  [  2]  give  detailed  procedures 
for  identifying,  fitting  and  checking  the  adequacy  of  the  fit  of 
the  appropriate  model  for  the  given  time  series.   The  programs 
developed  by  Bacon  implementing  these  procedures  have  been 
modified  to  suit  our  needs  and  are  described  in  detail  in  [481. 
These  procedures  will  become  clear  when  we  make  a  detailed  case 
study  with  an  example  in  the  next  chapter. 
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6.4   Forecasting 

One  of  the  primary  objectives  in  building  stochastic 
models  for  discrete  time  series  that  occur  in  many  practical 
cases  is  to  utilize  their  ability  to  forecast  the  future  values 
of  the  series. 

Let  Z  (I  )  ,  i  =1 ,  2,  ...  be  the  function  that  provides 
the  forecasts  at  origin  t  for  all  future  lead  times  (i   ).   This 
will  be  known  as  the  'forecast  function'  at  origin  t.   For  a 
general  AIRMA  model  (non-seasonal) 

&      (B)  Vd  Z.  =  G     (B)  a.  (6.4.1) 

p         t     q      t 

the  forecast  function  Z.  {I  )    may  be  expressed  directly  in  terms 
of  the  difference  equation  by: 

Z.  (£)    =  Z.   „  =^n  Z,  .  ,  +  ...  +$      Z,_  „    ,  -  0-    a,_  ,  , 
t        t+2  1  t+2-1  p+d   t+i-p-d     1   t  +  i-1 

-  ...  -  q      a.  ,  „    +  a.  ,  „      (6.4.2) 
uq   t+i-q     t+  i 

Box  and  Jenkins  [6]  show  that  the  minimum  mean  square  error 
forecast  Z    (  £  )     (f  >  0)  of  Z   .  is  the  conditional  expectation 

Ku)  =  rw  =  E[zt+flzt'  Vi'  -'] 

The  conditional  expectations  of  the  terms  in  (6.4.2)  are 
evaluated  by  inserting  actual  Z's  when  these  are  known,  fore- 
casted Z's  for  future  values,  actual  a's  when  these  are  known, 
and  zeroes  for  future  a's  (because  E[a   .]  =  0  for  j  >  0). 
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This  forecast  function  is  highly  useful  when  the  future 
values  are  needed  for  very  short  lead  times  as  required  in  many 
business  and  industrial  applications.   For  longer  lead  times 
the  forecast  error  will  be  cumulatively  larger.   Also,  as  the 
future  values  of  a*s  are  replaced  by  zeroes,  the  eventual  fore- 
cast function  takes  on  a  deterministic  mathematical  form  as 
dictated  by  the  solution  of  the  homogeneous  difference  equation 
containing  autoregressive  terms  only. 

Our  intention  of  fitting  a  time  series  model  for  the 
pixels  from  a  textural  scene  is  to  be  able  to  forecast  the  series 
for  longer  lead  times  and  thus  effect  the  texture  synthesis  from 
a  set  of  boundary  conditions.   The  forecast  function  will  be 
unsuitable  for  this  purpose  for  the  reasons  mentioned  above. 
Especially  the  eventual  disappearance  of  the  stochastic  effect 
is  highly  detrimental  for  the  textural  property  of  the  scene. 

6.5   Generation  of  Time  Series 

As  shown  in  Figure  6.2,  the  general  ARIMA  process  can  be 
generated  from  a  white  noise  process  with  appropriate  filtering 
operations.   Figure  6.2  shows  the  rearrangement  of  the  filters 
in  Figure  6.1  for  the  generation  of  time  series.   Where  $  (B)  Z,  = 
1)  (B)  v   Z.  and  a,  is  the  output  of  the  white  noise  generator.   The 
present  scheme  requires  (p+q+d)  delays  and  registers  to  store 
the  previous  occurrences  of  Z's  and  a's  which  are  required  in 
the  calculation  of  the  present  value.   The  multiplicative 
constants  (<$>  '  s  and  0's)  are  the  parameters  of  the  model.   To 
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Figure  6,2        Generation  of  Time  Series    [Z,  ] 
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start  with,  the  registers  are  loaded  with  the  'initial'  conditions 
and  the  values  of  Z     (i  >  0)  are  successively  regenerated. 

The  above  discussion  can  be  extended  to  seasonal  time 
series. 


6. 6   Synthesis  of  2-D  Texture 

So  far  we  have  considered  one-dimensional  time  series. 
By  concatenating  either  successive  rows  or  successive  columns, 
a  two-way  series  can  be  treated  as  a  one-way  time  series.   Of 
course,  by  doing  this  we  are  introducing  one  more  (known) 
periodicity. 

The  pixels  from  a  digitized  textural  scene  to  be  imitated 
('parent*  texture)  are  row  (or  column)  concatenated  to  form  a 
one-way  time  series  [  Z , ].   With  the  help  of  programs  USID*  and 
LIKESURF**,  an  appropriate  model  is  fitted  and  the  values  of 
the  parameters  are  estimated.   The  generation  process  shown  in 
Figure  6.2  is  simulated  in  GENTEX  ,  which  synthesizes  the 


Program  USID:   Univariate  Stochastic  Model  Identification. 
This  program  inputs  a  time  series  [ Zt]  and  plots  the  auto- 
correlation function  (acf),  r^  and  the  partial  auto-correlation 
function  (pacf),  ^^^  which  help  in  the  identification  of  the 
series.   For  details  see  [2,  6,  48]. 

•k  -k 

Program  LIKESURF:   This  program  plots  the  likelihood  surface 
over  the  specified  parameter  space  and  outputs  the  maximum 
likelihood  estimates  of  parameters  for  the  selected  model  for 
a  given  time  series.   See  [2,  6,  48]. 

+ 
Program  GENTEX:   This  program  synthesizes  the  textural  scene 

by  generating  the  pixels  for  a  set  of  boundary  conditions 

from  a  given  time  series  model.   Using  PAX  [46]  subroutines 

the  output  scene  is  printed  as  a  grey-level  picture. 

See  [  48]  . 
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textural  scene  from  a  set  of  boundary  conditions.   This  method 
is  illustrated  with  an  example  in  the  next  chapter. 

6.7   Redundancy  Reduction 

The  digitized  TV  scan  of  a  picture  is  a  row-concatenated 
one-way  time  series.   When  an  appropriate  model  is  fitted  for 
this  series,  we  come  up  with  an  attractive  scheme  for  redundancy 
reduction  in  the  transmission  of  the  TV  scan  of  the  picture.   In 
the  literature  [82]  we  find  a  method  known  by  the  name  'optimum 
linear  predictor'  in  which  the  next  value  in  the  series  is  pre- 
dicted by  expressing  it  as  a  linear  function  of  the  previous 
occurrences : 


yt  =  z    ei  Yt-i 

i=l  1  r  1 


t 


=  y  -  y   where   y   =  the  predicted  value 


y   =  the  actual  value 

e   =  the  error  in  prediction 

2 
0's  are  selected  to  minimize  the  mean  square  error  [  cr  (e  )]. 

Data  compression  (redundancy  reduction)  is  achieved  by  trans- 
mitting the  error  values  only.   At  the  receiving  end  the  actual 
values  (y's)  can  be  reconstructed  from  the  'errors'  (e's)  once 
the  system  has  been  properly  initialized. 

In  the  present  scheme  derived  from  the  time  series 
model,  a  one-step-ahead  forecast  is  made  by  expressing  the  next 
value  as  a  linear  function  of  not  only  the  previous  values  in 
the  series,  but  also  the  previous  'errors': 
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Z.  =  S   0.  z.  . 
t    .  ,   1   t-1 
1=1 


q 

s  e  .  a.  . 
,   1   t-1 
1=1 


(autoregressive  terms)  (moving  average  terms) 


[  zt  -  ztl 


where   Z^    =  one-step-ahead   forecast   of    ZJ 
t  1 

a,  =  the  'residual'  or  'error' 


The  values  of  $  's  and  e  's  are  selected  to  minimize  the  mean 

2 
square  error  [a     ].   We  can  see  that  this  is  an  improved  version 

GL 

of  the  'optimum  linear  predictor'  method  for  achieving  redundancy 
reduction  in  the  transmission  of  a  TV  scan  of  a  picture.   At  the 
receiving  end  we  can  perform  a  similar  'filtering'  operation  as 
shown  in  Figure  6.2  to  reconstruct  Z's  from  a's,  which  are 
transmitted. 
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7.   SYNTHESIS  OF  TEXTURE:   A  CASE  STUDY 

7.1   Selection  of  an  Appropriate  Model 

The  textural  scenes  that  are  used  in  the  following 

examples  are  taken  from  Brodatz  [7],   A  digitized  scene  of 

cheesecloth  texture  (D-105,  Brodatz  [7] )  with  16  graylevels  is 

considered  as  the  'parent  texture'  (Figure  7.1)  in  example  1. 

For  the  sake  of  analysis,  pixels  from  a  32  x  16  window  is 

treated  as  a  two-way  input  time  series.   It  is  row-concatenated 

(s  =  32)  and  is  given  as  an  input  one-way  time  series  (  [z  ]  , 

t  =  1,512)  to  the  program  USID*.   The  output  of  this  program 

consists  of  the  estimated  autocorrelations  for  [W  1  where 

w.  =  vnd  V  D  z   . 
t     1st 

(a)  for  the  original  series,  Z. 

i.e.,  d  =  0   D  =  0  [ACF-OO] 

(b)  for  the  series  differenced  once  with  respect 
to  basic  interval  only,  V,  Z 

i.e.  ,  d  =  1   D  =  0  [ACF-10] 

(c)  for  the  series  differenced  once  with  respect 

to  seasonal  interval  only,  v  Z^ 

s   t 

i.e.,d  =  0   D  =  1  [ACF-01] 

(d)  for  the  series  differenced  once  with  respect 

to  both  basic  and  seasonal  intervals,  V,     Z^ 

'1st 

i.e.  ,  d  =  1   D  =  1  [ACF-11] 


* 


See  footnote  in  section  6.6. 
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Figure  7.1   Cheesecloth  Texture 


™S  JTO'ii'y*  "■ 


Figure  7.2   Synthesized  Texture 
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Figure  7.3  shows  the  plots  of  the  autocorrelation  functon 
(ACF)  and  partial  autocorrelation  function  (PACF)  for  all  the 
four  cases  mentioned  above.   The  partial  autocorrelation  function 
is  more  useful  in  the  identification  of  the  non-seasonal  models 
and  hence  is  not  further  discussed. 

The  autocorrelation  values  in  case  (a)  are  large  and 
highly  periodic  as  might  be  expected.   In  case  (b)  it  is  seen 
that  by  differencing  with  respect  to  the  basic  interval  reducing 
the  correlation  in  general  while  a  heavy  periodic  component 
remains.   We  obtain  stationarity  by  differencing  with  respect 
to  the  seasonal  interval  as  seen  in  cases  (c)  and  (d)  where  the 
correlation  values  diminish  very  rapidly.   The  values  of  d  and 
D  which  produce  stationarity  in  the  present  case  are  0  and  1 
respectively. 

A  prospective  model  is  selected  for  further  analysis 
based  on  the  information  furnished  by  the  autocorrelation 
function  by  referring  to  Table  3.2  [2]  and  Appendix  A9.1  [6]. 
In  practice  we  can  pick  up  many  tentative  models  and  even 
probably  overparameterize  them.   The  program  LIKESURF*  is  used 
to  estimate  the  parameters  of  a  given  model  from  analyzing  the 
input  data.   This  program  is  capable  of  checking  many  models 
at  a  time  and  its  output  indicates  the  adequacy  of  any  model 
as  well  as  any  redundancy  in  the  choice  of  number  of  parameters. 

By  the  procedure  mentioned  above,  we  select  the  follow- 
ing model  to  represent  the  given  data: 


* 
See  footnote  in  section  6.6 
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Figure  7.3  Serial  Correlations  in  Example  1 
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(1  -  *   BS)  Wt  =  (l-\    B)(l-^s  BS)  at  7.1.1 

where  W.  =  V   Z. 
t     s   t 

s  =  length  of  season  (length  of  row) 

7. 2   Estimation  of  the  Parameters 

We  need  to  estimate  the  values  of  four  parameters 
($  ,  X  -^ ,   XQl    aa)    by  analyzing  the  input  data. 

\   =  (1+4)  Zt_s  -*  Zt_2s  +at-  \   at_1 

_  \     a     +   X     X     3l 

st-s     lst-s-1  7.2.1 

With  the  knowledge  of  a    a+-_i  >    a+-  o  >    etc*   We  can  make  a  one- 
step-ahead  forecast: 

Zt+1  =  (H4j  Zt+1_s  -«  Zt+1_2s  -  \  at  -  ^  at+1_s 

+  ^  Xs  at_s  7.2.2* 

/■v 

The  'residual'  a   ,  =  z-»-4.i  ~  z+-  +  i  '  i*e*/  tne  residuals  are  con- 
sidered on  the  one-step-ahead  forecast  errors.   With  appropriate 
starting  values  we  can  see  that  the  values  of  a   can  be  recursively 
calculated  for  a  given  set  of  parameters. 

7.2.1  A  Method  to  Obtain  Starting  Values  for  Recursive 
Calculations  of  Residuals 

A  procedure  to  obtain  the  starting  values  is  described 

in  detail  and  illustrated  with  an  example  in  Chapter  9  of  the 

book  by  Box  and  Jenkins  [ 61  .   It  is  as  follows:   For  a  given 


* 


While  forecasting  the  unknown  values  of  a   are  replaced  by 
their  expected  value.   In  this  case  E(a   ,)  =  o. 
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set  of  parameters  the  series  may  be  forecast  backwards  starting 
somewhere  in  the  middle  of  the  series.   To  begin  with  the 
unknown  a's  are  assumed  to  be  zero.   This  introduces  transients 
which  will  hopefully  die  down  by  the  time  Zn ,  Z_, ,  Z  „ ,  etc. 
are  estimated,  provided  the  starting  point  is  chosen  sufficiently 
far  along  the  series.   The  back- forecast  continues  till  we  obtain 
sufficient  number  of  terms  to  be  able  to  forward- forecast  the 
first  value  (Z, ) : 

Z,  =  (1+$)  Z,    „  -  <£  Z,  - 
1  1-s       l-2s 

Here  we  need  the  values  till  Zn  _   and  the  values  of  a.  for 

l-2s  t 

t  <  1  is  assumed  to  be  zero. 
Now 

A. 
ai   =   Zl   "   Zl 

7.2.2   Sum  of  Squares  Function 

From  now  on  we  can  recursively  estimate  the  values  of 
residuals  a, ,  a_,  ...  a  .   We  define  a  sum  of  squares  function 
' S"  as  : 

S(*f  \    \  )  =  L       a* 
is     t=l   r 

We  obtain  the  least  squares  estimate  of  the  parameters  by  picking 

a  set  of  values  (0  ,  X  ,  ,  X  )  which  provides  the  minimum  sum  of 

'   1 '   s 

squares,  S  .  .   It  is  shown  in  [2,    6]  that  likelihood  estimates 
n      '   min  ' 

are  same  as  the  least  squares  estimates  if  we  assume  that  a's 
are  normally  distributed.   Under  the  assumption  program  LIKESURF 
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actually  plots  the  sum  of  squares  function  and  obtains  a  set  of 
values  that  make  it  minimal. 

Using  the  program  LIKESURF  the  following  model  is  fitted 
to  example  1. 

(1  +  0-15  Bs)  V  z   =  (1  _  0-25  B)(l  -  0-5  BS )  a^ 

s   t  t 

where  °2   =  1-03 
a 

7. 3   Checking  the  Adequacy  of  the  Fit 

According  to  the  model  the  residuals  a   are  generated  by 
a  white  noise  process.   If  the  fit  were  to  be  adequate,  the 
calculated  residuals  should  be  uncorrelated.   Figure  7.4  shows 
the  correlation  values  of  the  residuals.   It  can  be  seen  that 
the  values  are  fairly  small  and  there  is  no  periodic  component 
either.   Thus,  it  offers  no  significant  departures  from  randomness 
among  residuals,  confirming  the  adequacy  of  the  fit. 

As  mentioned  in  the  previous  chapter  we  can  also  check 
the  adequacy  by  comparing  the  actual  values  to  the  forecast 
values  from  any  origin. 

Forecasting  is  done  on  the  same  principle  as  before 

(i.e.,  using  difference  equation  approach).   The  values  of  a 

for  t  >  t        is  set  to  zero, 
origin 

Figure  7.5  shows  the  actual  values  (solid  line)  and 

forecast  values  (crosses)  from  the  origin  t  =  128.   Considering 

the  limited  number  of  parameters  steering  the  model,  the  forecast 

function  follows  actual  values  rather  closely  even  for  t  »  t 

1  origin, 
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Figure  7 .k     Serial  Correlations  of  Residuals  in  Example  1 


H50.Q     '.,oo. n 


Figure  7.5  Forecast  Values  (shown  by  x)  in  Example  1 
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7.4   Generation  of  Texture 

We  can  create  a  white  noise  generator  having  a  mean  =  0 

2 
and  the  variance  a    ,  which  generates  the  residuals  a  .   To  start 

the  recursive  procedure  for  the  generation  of  future  values  we 

need  at  least  2s  values  of  Z  .   These  can  be  considered  as  the 

boundary  conditions.   Figure  7.2  shows  the  texture  synthesized 

in  this  manner.   Here  using  two  rows  of  length  64  (s  =  64)  from 

the  original  scene  as  the  starting  values,  the  future  values  of 

the  pixels  have  been  generated  by  the  procedure  mentioned  above. 

One  of  the  ways  of  testing  the  effectiveness  of  the 
scheme  of  synthesis  is  by  attempting  to  fill  the  holes  in  the 
'parent'  texture.   The  results  are  shown  in  Figure  7.6.   We 
notice  some  edge  effects  here.   This  can  be  expected  in  the  case 
of  structural  textures.   It  is  possible  to  minimize  these  effects 
In  the  present  case  we  have  used  pixels  from  two  rows  parallel 
to  the  top  edge  of  the  hole  as  the  starting  values.   Instead  we 
can  incorporate  pixels  from  a  couple  of  rows  and  columns  which 
are  parellel  to  each  edge  of  the  hole  as  boundary  conditions. 
Then  we  can  proceed  to  patch  the  hole  by  forward  forecasting 
from  top  edge  and  backward  forecasting  from  bottom  edge  (as 
suggested  in  7.2.1).   In  the  center  we  can  average  out  the  values 
forecasted  from  either  side,  thus  reducing  the  edge  effects. 

Let  us  consider  a  different  class  of  textures  in  the 
second  example.  The  texture  of  handmade  paper  (Figure  7.7a) 
belongs  to  general  class  of  statistical  textures.   It  has  no 
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(a) 


(b) 


Figure  7.6   Filling  the  Holes  in  a  Textural 
Scene  (Example  1) 
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structure.   The  seasonal  time  series  model  fitted  for  this 
texture  is  of  the  form: 

(1  -  0-8  BS)  Z   =  (1  +  0-25  B)(l  -  0-5  BS )  at 

where  o2   =  3«27 
a 

Figure  7.7b  and  Figure  7.7c  show  the  results  of  hole- filling 
operation  using  above  model.   Here  the  edge  effects  are  hardly 
noticeable. 

We  have  shown  that  it  is  possible  to  synthesize  natural- 
looking  textures  using  the  time  series  model.   This  method  is 
particularly  suitable  in  the  case  of  statistical  textures. 
Many  biomedical  textures  of  interest  are  statistical  in  nature. 

7.5  A  Method  for  Determinining  the  Size  and  Shape  of 
Template  Used  in  Decision  Theory  Method 

It  is  possible  to  determine  the  appropriate  size  and 

shape  of  template  with  the  help  of  parameters  derived  from  the 

time  series  analysis  of  the  texture  scenes.   We  illustrate  the 

method  with  an  example. 

Let  the  textures  used  in  examples  1  and  2  belong  to 

1      2 
families  T   and  T   respectively,  which  are  represented  by  the 

following  time  series  models: 

(1  +  0-15  BS)  V  Z^  =  (1  -  0-25  B)(l  -  0-5  BS )  a,.   ...   7.5.1 
st  t- 

(1  -  0-80  BS)  Z   =  (1  +  0-25  B)(l  -  0-5  BS )  a    ...   7.5.2 

2 

2 
where  cr   =  variance  of  a   's  =  1-03 
I  tx 

2 
ff   =  variance  of  a   '  s  =  3*27 

z 
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(a) 


(b) 


(c) 


Figure  7.7   a.  Texture  of  a.  Handmade  Paper 

b.  Holes 

c.  Resultant  Scene  after  Filling 
the  Holes 
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We  shall  rewrite  the  above  models  as  pure  autoregressive 
models  of  the  form: 


1(B)Zt=at;   i=l, 2    ...  7.5.3 

i 


~1         ~2 
The  autoregressive  operators  §  (B)  and  $  (B)  are  polynomials  in 

B  and  their  coefficients  are  arranged  diagrammatically  and  shown 

in  Figure  7.8.   These  values  indicate  the  influence  of  the 

neighboring  pixels  in  determining  the  values  of  Z , ,  apart  from 

the  residual,  a   whose  mean  value  is  zero.   Figure  7.8d  shows 

the  template  which  picks  up  Z,  and  its  neighboring  pixels.   The 

set  of  pixels  picked  up  by  the  template  constitutes  an  'event1, 

as  defined  before.   The  autoregressive  operator  operating  on 

Z  can  be  viewed  as  if  the  'event'  picked  up  by  the  template  is 

passed  through  the  'filter'  formed  by  the  coefficients.   The 

contour  of  the  smallest  significant  coefficient  value  determines 

the  upper  limit  on  the  size  and  shape  of  the  template.   For,  the 

selection  of  a  larger  template  would  not  yield  any  new  information 

on  'local  properties'  of  the  texture  scene.   Equation  7.5.3 

indicates  that  the  'events'  picked  up  by  this  template  when 

passed  through  appropriate  'coefficient  filters'   the  output 

consists  of  random  shocks,  ' a  ' ,  which  are  normally  distributed. 

From  engineering  point  of  view,  we  can  considerably  reduce  the 

size  and  shape  of  template,  and  yet  preserve  the  above-mentioned 

property  (approximately)  by  selecting  a  suitable  cut-off  value 

of  the  coefficients. 

1       2 
In  the  case  of  texture  families  T   and  T  ,  the  template 

6  (shown  in  Figure  7.9)  appears  to  be  suitable.   The  output  of 
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1       2 
the  'coefficient  filters',  C   and  C   (Figure  7.8)  appears  to 

1      2 
be  fairly  random  when  'events'  extracted  from  T   and  T   are 

passed  through  them,  respectively.   The  randomness  is  tested 

by  plotting  the  autocorrelation  function  of  the  output  (ACFll , 

ACF22  in  Figure  7.11). 

In  the  decision  theory  method,  we  need  to  consider  one 

more  criterion,  viz.  the  template  size  and  shape  should  be 

judicially  selected  in  order  to  effect  good  discrimination 

between  the  pair  of  texture  families  considered.   We  show  how 

the  coefficient  values  of  the  autoregressive  operators  help  make 

this  choice  too. 

1       2 
The  OC  curves  for  T   and  T   families  are  obtained 

(Figure  7.9)  using  the  six  templates  shown.   Here  we  notice 

that  template  #3  is  more  discriminating  than  the  template  #2 

although  both  are  of  the  same  size.   The  explanation  is  as 

i ~1    ~2 i 
follows:   Consider  diagram  of  values  |C  -  C  |  (Figure  7.8c). 

It  can  be  seen  that  coefficients  of  B  are  more  distinctly  differ- 

g 
ent  than  those  of  B  .   That  means,  the  influence  of  Z   ,  on  Z. 

1       2 
is  more  discriminatingly  different  in  T   and  T   than  that  of 

Z.    on  Z  ,  and  so  is  the  joint  distribution  of  [Z   ,  ,  Z  ] 

as  opposed  to  [  Z    ,  Z. ] . 

So  in  making  choice  of  size  and  shape  of  the  template 

1       2 
for  T   and  T  we  need  to  consider  that  the  corresponding  cells 

~1  ~  2      l  ~1   ~2  l 
where  there  are  significant  values  of  C  ,  C   and  I  C  -CI  are 

accounted  for  and  that  it  meets  any  optional  requirements  like 

connectivity,  symmetry,  etc.   After  making  this  choice,  we 
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0.45       0.60       0.75 

<FRLSE  flLflRMS> 


0.90 


1.0  1.05 


Figure  7.9  O.C.  Curves  for  T1  and  T2 
(Obtained  using  the  set  of 
templates  shown. ) 
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have  to  check  whether  or  not  in  its  truncated  form,  the  corre- 
sponding autoregressive  operator  would  approximately  satisfy  the 
equation  7.5. 3. 

Figure  7.10  shows  the  results  of  texture  discrimination 
by  the  decision  theory  method  for  the  six  templates  shown  in 
Figure  7.9. 

7. 6   Texture  Recognition 

We  have  seen  that  events  extracted  from  a  homogeneous 
texture  region  if  passed  through  appropriate  'coefficient  filter', 
the  output  consists  of  uncorrelated  random  noise.   The  auto 
correlation  function  can  be  employed  to  test  this  randomness. 
Using  this  property,  we  can  recognize  textures  belonging  to  same 
family  and  discriminate  others. 

We  tested  this  hypothesis  by  extracting  events  from  T 

2 
and  T   using  template  6  and  we  filtered  them  using  'coefficient 

~1     ~2 
filter'  C   and  C  .   We  plotted  the  autocorrelation  function  of 

the  output  in  all  four  cases,  ACF11,  ACF12,  ACF21,  ACF22* 
(Figure  7.11).   For  the  sake  of  comparison  we  plotted  the  auto- 
correlation function  of  the  output  of  the  random-noise  generators, 

a    and  a    (ACF10  and  ACF20).   We  notice  that  in  spite  of  trunca- 
1        2 

tion  of  the  template,  quantization  noise,  etc.,  the  output  of 
filters  is  fairly  random  for  the  right  input  (ACF11 ,  ACF22)  and 
not  so  in  other  cases  (ACF21,  ACF12).   This  process  can  be  easily 
extended  to  treat  the  case  of  multiple  textures. 


Here  first  number  indicates  the  texture  region  and  second 
one  points  to  the  filter. 
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8.   TWO-DIMENSIONAL  FORMAL  GRAMMARS  FOR 
GENERATING  TEXTURE  SCENES 


8.1  Linguistic  Approach 

The  linguistic  approach  to  pattern  recognition  is  not 
uncommon  in  this  field  [83] .   Formal  grammars  have  been  written 
to  generate  sentences  which  describe  patterns.   The  automata 
that  would  accept  the  languages  generated  by  these  grammars  do 
possess  pattern  recognition  capabilities.   Recently  introduced 
grammars  for  two-dimensions  are  capable  of  generating  patterns 
in  2-D  space.   These  grammars  known  as  'Array  Grammars'  (AG) 
are  considered  as  a  two-dimensional  generalization  of  context- 
sensitive  grammars.   The  formal  properties  of  these  grammars 
and  those  of  array  automata  that  accept  these  'array  languages' 
have  been  studied  by  Milgram  and  Rosenfeld  [51,  52 1. 

In  the  next  section  we  study  the  terminology  introduced 
by  Milgram  and  Rosenfeld  for  defining  array  grammars  and  the 
corresponding  array  automata. 

8. 2  Array  Grammars  and  Array  Automata 

An  'array  grammar'  (AG)  is  defined  to  be  a  quintuple:  G  = 
(V,  S#  R,  #,  s)  where  V  is  a  finite  set  of  symbols  called  the  vocab- 
ulary,  jcV  is  called  the  terminal  vocabulary,  Se  V  -Sis  the  initial 
symbol,  #  e  V  -  z   is  the  blank  symbol,  R  is  a  finite  set  of  rewriting 

rules ,  each  of  which  is  a  pair  (T  ,  T  ' )   where  p  is  a  finite 
P   p 
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connected  subset  of  I  x  I  and  r  ;  r  •  are  mappings  from  p  into  V. 

ir  ir 

The  terminal  symbols  are  never  rewritten,  i.e.,  if  (i,  j)  e  p 
and  r  ( i ,  j )  =  a  e  Z ,  then  r • ( i ,  j )  =  a . 

ir  ir 

An  initial  array  A  , is  a  mapping  from  I  x  I  onto  i#,  s}, 
such  that  {(i,  j)|  A  (i,  j)  =  S}  is  a  singleton.   In  other 
words,  an  initial  array  is  all  blanks  except  for  one  S.   A 
terminal  array  A   is  a  mapping  from  I  x  I  into  Z  U  #  such  that 
{(i,  j)|A  (i,  j)e  z]       is  connected.   The  'array  language'  L 


R 

s 

is  an  initial  array  and  B  is  a  terminal  array. 


generated  by  an  array  grammar  G  is  L(G)  =  {b|a  ==>  B }  where  A 

s  s 


8.2.1  Monotonic  Array  Grammar 

If,  in  the  course  of  derivations  the  arrays  never 
'shrink'  (i.e.,  the  blank  symbol  is  not  generated);  in  other 
words,  if  the  number  of  non-blank  symbols  is  monotonically 
non-decreasing,  the  AG  will  be  called  'monotonic  array  grammar' 
(MAG). 

8.2.2  Turing  Array  Automaton 

A  turing  array  automaton  (TAA)  is  a  quintuple:   T  = 

(Q,  Z,    5,  q  ,  F)  where  Q  is  a  finite  set  of  states  of  the 

form  Q'  x  A (where  A=  L,  R,  U,  D)*.   Any  member  of  the  set  Q  is 

of  the  form  (q. ,  x) ,  x  e  A  which  indicates  the  present  internal 

state  (q. )  of  TAA  and  the  direction  of  its  previous  motion  (x). 

Z    is  a  finite  set  of  symbols.   (q  ,  R)  e  Q  is  a  start  state. 

F  c  q  is  a  set  of  final  states.   5  is  a  mapping  from  Q  x  Z   into 
9Q  x  z    x  a 


*  indicates  the  direction  of  motion  of  TAA.  Assuming  4-point 
neighborhood,  TAA  can  move  in  four  directions:  viz.  left  (l) 
right  (R) ,  up  (U)  or  down  (D). 
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A  transformation  in  5  of  the  form  ((p,  x),  A)  =» 
((q,  Y) ,  B,  Y) ,  x,  Y  e  A  is  interpreted  as  follows:   If  T  is 
in  internal  state  p  and  has  just  moved  in  direction  x  and  reads 
a  symbol  A,  then  it  goes  into  an  internal  state  q,  writes  a 
symbol  B  and  moves  in  direction  Y. 

Let  g  be  an  array  on  z  which  is  finite  and  connected. 
If  T  starts  at  some  point  (i,  J)  in  its  start  state  and  reads 
(and  rewrites)  the  values  of  the  points  in  the  array  as  it  moves 
around,  it  "accepts"  G  if  it  ever  goes  into  a  final  state. 

8.2.3   Array  Bounded  Automaton 

A  TAA  is  considered  as  an  "array  bounded  automaton" 
(ABA)  if  it  always  "bounces"  off  a  blank  symbol  (#) ,  i.e.,  every 
triple  in  the  image  of  any  ((p,  x) ,  #)  under  5  is  of  the  form 
( (q,  x"1) ,  #,  x_1) ,  x  e  A. 

The  following  two  theorems  are  stated  and  proved  by 
Milgram  and  Rosenfeld  [51,  521  . 

Theorem  1.   Let  £  be  the  language  of  an  AG;  then  there 
exists  a  TAA  that  accepts  just  the  arrays  of  £ .   Conversely, 
let  II  be  the  input  arrays  accepted  by  a  TAA;  then  there  exists 
an  AG  whose  language  is  II  . 

Theorem  2.   Let  .?,    be  the  language  of  an  MAG;  then  there 
exists  an  ABA  that  accepts  just  the  arrays  of  £ .   Conversely, 
let  n  be  the  input  arrays  accepted  by  an  ABA;  then  there  exists 
an  MAG  whose  language  is  n , 

In  the  next  section  we  write  some  monotonic  array 
grammars  that  would  generate  texture  scenes.   We  define  the 
ABA  that  would  recognize  these  texture  scenes. 
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8. 3   Examples  of  MAG's  Which  Generate  Texture  Scenes 

If  the  terminal  symbols  (Z)  in  an  array  grammar  represent 
gray  levels,  then  the  'sentences'  of  the  array  grammar  can  be 
considered  as  the  two-dimensional  scenes.   We  write  some  MAG's 
which  generate  some  commonly  occurring  texture  scenes. 

I.   Checkerboard  pattern 

G   :   {V,  z,  R,  #,  S} 
R   : 


(1) 


0  1 


*(2)       [0x  #1    -*    [0x   1] 
(3)       [1      #]    ->    [1      0] 


V  =  {#,  S,  0,  1} 
2  =  (0,  1} 

x  e  A  =  (L,  R,  U,  D}  + 
X  e  A  =  (L,  R,  U,  D} 


The  starting  symbol  is  rewritten  as  0  or  1  in  the 
starting  array  (A  ).   Then  every  #  symbol  in  the  neighborhood 
of  0  or  1  is  rewritten  as  1  or  0  respectively. 

For  this  simple  grammar  G,  we  illustrate  how  to  specify 
an  ABA  (T)  that  accepts  L(G). 

Array  Bounded  Automaton,  T:   {Q,Z,8,q,F} 

Q':   (internal  states):   {  qg ,  qt ,  qp,  qN,  qs,  q#,  qQ ,  q^ 
Z    :       V  u  (V  x  V)     where  V  =  {0,  1,  #} 

and    V  =  {0,  1,  #,  S} 


For  convenience  in  representation  we  use  the  following  short- 
hand notation 

CRA  for  [  CA]  ;  CLA  for  [AC],   CyA   for  [^~] 
and(_J  is  represented  as  [C_A] 
We  assume  a  4- point  neighborhood. 
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and  F   :   [  qp,  x} ,  X  e  A  =  {L,  R,  Uf  D} 

8:  [In  the  following  rules,  xe  a  and  Y  e  a] 

(1)  ((qs,  x),  a)  ->  {((qs,  Y)  ,  (a,  #)  ,  Y)  U 

((q  ,  Y)  ,  (a,  S)  ,  Y)}  ,  a  =  0  or  1 
S 

The  ABA  can  remain  in  the  start  internal  state  (q  )  and 

^s 

move  around,  rewriting  a's  as  (a,  #)'s;  it  changes  its  state  to 
(qq)  only  when  it  rewrites  one  of  the  a's  as  (a,  S). 

(2)  5  ((qs,  x),  (0,  S))  -  ((qQ,  Y) ,  (0,  0),  Y) 
(2)'  5  ((qs,  x),  (1,  S))  ~*    ((q1#  Y)  ,  (1,  1),  Y) 

When  in  state  q  ABA  rewrites  (a,  S)  as  (a,  a)  and 

goes  into  state  q   for  a  =  0  or  1. 

(3)  5  ((q1#  x),  (0,  #))  -  ((q0,  Y),  (0,  0),  Y) 
(3)'  6  ((qQ,  x),  (1,  #))  -  ((qlf  Y),  (1,  1),  Y) 

When  in  state  qn  or  q,  if  it  reads  a  symbol  (1,  #)  or 
(0,  #)  it  rewrites  them  as  (1,  1)  or  (0,  0)  and  goes  into  a 
state  q1  or  q~  ,  respectively. 

(4)  5  ((q  .  x),  #)  -  ((q    x"1),  #,  x-1) 

c  # 

for  c  =  (S,  1,  0,  #) 
Being  an  ABA,  as  it  should,  it  'bounces'  off  a  blank 


symbol 


(5) 


5  (  ( qc  ,  x )  ,  ( a  ,  A  )  )  ->  (  ( qt ,  x" 1 )  ,  ( a  ,  A  )  ,  x'1) 

for  c  =  (S,  1,  0,  #) 
a  =  (0,  1) 

A  =  (0,  1,  #,  S) 
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The  ABA  at  any  stage  can  go  into  a  state  q  and  reverse 
its  latest  move. 

On  the  first  rule  of  5  ,  a  'starting  array*  is  created 
in  the  second  term  of  each  pair  rewritten  and  in  the  following 
rules,  ABA  has  been  imitating  the  rules  of  MAG.   Every  non- blank 
symbol  in  the  terminal  array  that  is  submitted  for  acceptance 
can  be  rewritten  as  a  pair  (0,  0)  or  (1,  1)  only  if  it  were 
the  sentence  generated  by  G.   After  the  ABA  has  moved  into 
the  state  q. ,  then  some  new  commands  can  be  given*  to  T ,  by 
which  it  moves  around  and  goes  into  final  state  q„  accepting 
the  'sentence'  if  it  finds  that  every  connected  non-blank 
symbol  is  a  pair  of  the  form  (0,  0)  or  (1,  1).   Otherwise  it 
goes  into  q  and  rejects  the  sentence. 

In  this  example  we  have  shown  how  to  specify  an  automaton 
that  has  texture  recognition  property  given  a  grammar  that 
generates  texture  scenes. 
II .   Horizontal  lines 

G  is  same  as  before ,  except  for  R. 


R: 


(1) 


rr 

rcr 

r1" 

r°~] 

—> 

0 

0 

i 

L#J 

^iJ 

Lo_j 

LOJ 

(2)   0x#J  ~0xaJ 


for  a  =  {0,  1} 
and  x  =  L ,  R 


(3) 


ro- 

r°i 

0 

- 

0 

L#J 

_lJ 

(3'  ) 


r#" 

rll 

0 

—* 

0 

I  0  J 

l-OJ 

Milgram  and  Rosenfeld  have  proven  that  an  ABA  can  determinis- 
tically  decide  whether  or  not  a  given  array  consists  only  of 
specified  finite  set  of  symbols  [51,  52]. 
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(4) 


(5) 


11 

l 

0 

-* 

0 

#_ 

Lo. 

ol      ro 

ih 

1 

#- 

_o 

(4'  ) 


(51  ) 


r#i 

r° 

i 

_» 

i 

loJ 

Lo 

r#- 

r° 

0 

-» 

0 

llj 

-i 

After  S  is  rewritten  in  the  context  as  shown  in  rule  1, 
rules  3,4,  5  show  how  expansion  is  carried  in  the  vertical 
direction.   A  '#'  is  rewritten  as  ' 1'  if  a  pair  of  pixels  just 
above  or  below  are  both  '0's.   If  any  one  happens  to  be  1,  then 
#  is  written  as  0.   Rule  2  shows  the  horizontal  expansion. 

This  grammar  generates  picture  scenes  with  horizontal 
parallel  lines  with  2-unit-spacing.   In  the  same  way  we  can 
generate  vertical  lines,  slanted  lines,  etc. 


Ill 


R: 


Herringbone  pattern 

G  same  as  above  ,  except  for  R. 


(1) 


(2) 


(3) 


(4) 


(5) 


"S  #  #  #" 

#  #  #  # 

#  #  #  #. 

0  1  0  #" 

1  0  1  # 
0  0  0  #_ 

"1  o  0  #" 

0  1  0  # 
.0  0  1  #. 

~0  0  0  #" 

1  0  1  # 
.0  1  0  #. 

r0  0  1  #" 

0  1  0  # 

1  0  0  #. 


0 

0 

1 

01 

0 

1 

0 

1 

1 

0 

0 

0J 

"0    10    0' 
10    10 

0  0    0    1. 

1  0   0    (T 
0    10    1 

L0    0    1    0.J 

ro  o  o  r 

10    10 
0    10    0^ 

0    0    10"^ 
0    10    1 
10    0    0J 


(2'  ) 


(3'  ) 


(4*  ) 


(5'  ) 


#10    0" 
#010 
l#   0    0    1_ 

#000" 
#10    1 
L#    0    1    0_ 

"#0    0    1' 

#010 

L#   1    0    0. 

~#    0    1    0' 
#10    1 
#0    0    0- 


"0    10    0' 
10    10 
0    0    0    1. 


1 

0 

0 

°1 

0 

1 

0 

1 

0 

0 

1 

OJ 

0    0    0    1 

10    10 

L0    1    0    0- 

ro  oio" 

0    10    1 
10    0    0 


100 


(6) 


(7) 


(8) 


on 

^"0 

l 

— > 

1 

#J 

,0 

on 

r° 

0 

-» 

0 

#J 

Li 

1~ 

ri 

0 

— » 

0 

#- 

^0 

(6-  ) 


(V  ) 


(8'  ) 


0 

_i_ 

— » 

^°1 

0 

-1_ 

0 
^0^ 

~* 

0 

lO  J 

i 
.o_> 

~* 

i 

loJ 

As  we  can  see  it  is  becoming  increasingly  cumbersome  to 
specify  the  rewriting  rules  even  for  very  simple  texture  scenes, 
This  is  so  because  of  some  limitations  in  array  grammars  which 
will  be  discussed  in  more  detail  in  the  next  section. 


IV.   Statistical  textures 

We  have  seen  that  structural  textures  can  be  generated 
by  array  grammars.   For  generating  statistical  textures  we  can 
extend  the  concepts  of  array  grammars  to  introduce  stochastic 
array  grammars  in  the  same  way  as  in  linear  grammars. 

A  stochastic  array  grammer  can  be  defined  as  a  weighted 
array  grammar  in  which  the  rewriting  rules  R  have  an  associated 
weight  as  shown: 


r 


ID 


j  =  1  ...  n± 
i  =1  ...  k 


where  k  indicates  the  number  of  distinct  sets  of  rules  in  R  such 

that  the  left  member  is  same  in  every  rule  belonging  to  the  same 

set. 

0  <  p.  .  (weight  or  probability)  <  1 


nk 
and   2  p.  .  =  1 


j=l 


ID 


for  all  i 
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The  following  grammar  illustrates  how  a  statistical 
texture  can  be  generated. 

G:   {V,  z,    R,  S,  #} 


R: 


(1)   [  S  #]  -  [S  si  V  =  {S,  #,  0,  1} 


for  xe  A     £={0,1} 


(2)  S   °^6   0 

(3)  S   ^>4   1 


The  scene  is  first  filled  by  the  nonterminal  'S'  and 
then  S  is  rewritten  as  1  with  a  probability  0*4  and  as  0  with 
probability  0*6.   It  is  obvious  that  this  grammar  generates 
'salt  and  pepper'  scenes. 

8.4  Multilevel  Array  Grammars 

Before  introducing  this  special  class  of  two-dimensional 
grammars,  we  shall  study  the  limitations  of  the  conventional 
array  grammars  as  defined  by  Milgram  and  Rosenfeld. 

8.4.1   Limitations  of  Conventional  Array  Grammars 

By  virtue  of  their  definition,  there  are  some  limitations 
in  conventional  array  grammars  which  make  them  uneconomical  in 
terms  of  rewriting  rules  in  representing  complex  texture  scenes 
as  we  have  seen  in  the  previous  section. 

First  of  all,  according  to  the  definition,  a  terminal 
symbol  is  never  rewritten.   Hence,  a  nonterminal  symbol  is 
rewritten  as  a  terminal  symbol  only  once  during  the  course  of 
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derivations.   Also  each  nonterminal  will  eventually  occupy  only 
one  cell  in  the  terminal  array.   These  restrictions  make 
nonterminal  symbols  much  less  powerful  as  far  as  expansion  is 
concerned  than  their  counterpart  in  linear  grammars. 

The  necessity  for  the  presence  of  these  restrictions 
can  be  explained  in  the  following  manner:   In  linear  grammars 
the  expansion  takes  place  in  only  one  dimension.   There  is  no 
problem  of  juxtaposing  the  expansions  of  neighboring  nonterminals, 
Whereas ,  the  expansion  of  a  nonterminal  in  an  array  grammar 
takes  place  in  two-dimensions.   To  make  a  meaningful  scene 
("2-D  sentence"),  the  "shape"  of  expansion  of  any  nonterminal 
should  be  compatible  to  that  of  its  neighboring  nonterminal  so 
that  there  are  no  'holes'  created  while  juxtaposing  these 
expansions.   It  is  a  non- trivial  problem  to  specify  the  shape 
of  unrestricted  expansion  of  every  nonterminal  that  would 
satisfy  this  requirement. 

8.4.2   Introduction  to  Multilevel  Array  Grammars 

As  much  as  we  would  like  to  have  the  same  powers  of 
expansion  for  nonterminals  as  found  in  linear  grammars,  we  are 
forced  to  make  some  compromises  because  of  the  problems  involved. 
Generalizing  the  concept  of  conventional  array  grammars,  we 
introduce  what  are  known  as  "multilevel  array  grammars"  (MLAG). 
As  the  name  would  suggest  there  are  many  levels  and  at  each 
level  several  grammars  are  defined.   These  grammars  at  any  level 
resemble  the  conventional  array  grammars  in  every  sense  except 
for  one  main  difference.   The  so-called  'terminal  symbols'  at 


103 


level  >  0  are  not  exactly  terminals  in  the  conventional  sense 
which  is  true  only  at  the  lowest  level,  0.   They  are  in  fact 
•sentences'  of  particular  'shape'  which  are  derived  by  a  set  of 
grammars  defined  at  next  lower  level.   It  is  assumed  that  all 
the  terminals  at  any  level  have  the  same  'shape'  and  this  shape 
information  is  embedded  in  the  definition  of  all  grammars  at 
that  level.   Finally,  all  the  'sentences'  of  MIAG  should  consist 
entirely  of  a  connected  set  of  terminal  symbols  defined  at  level 
0  only.   Grammars  at  intermediate  levels  act  as  subroutines 
that  would  expand  the  terminal  symbols  at  highest  level  in  terms 
of  those  defined  at  level  0. 

8.4.3   Definition 

A  multilevel  array  grammar  (MLAG)  can  be  formally 
defined  as  a  set  of  6- tuples: 

i  =0,  1  ...  p 


(Qi) 


J  -  1 /  2  ...  n .  and  n   =1 

1      P 


where 


Gj  =  (VJ'  Ej'  Q±'  Rj'  S±'    #i} 

Here  the  superscript  i  indicates  the  level.   The  MLAG 
is  said  to  be  of  order  'p'  if  there  are  p  +  1  levels  (0  thru  p) 

V.  =  'vocabulary'  of  j    grammar  at  i    level 

*  j_  i_  4-1^ 

Z1.    =  'terminal  symbols'  of  j    grammar  at  i    level 
S   =  'start  symbol1  at  i    level:   same  for  all  j 
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#  =  'blank  symbol1  at  i    level:  same  for  all  j 

Q   =  'shape  parameter'  contains  information  as  to  how 
many  cells  each  member  of  V^  for  all  j  would 
eventually  occupy  in  the  'final  array'  (the 
'sentence'  of  MIAG). 

Q   is  said  to  define  the  size  and  shape  of 
'unit  cell'  at  level  i.   It  is  generally  expressed 
in  terms  of  Q    in  the  form  of  a  template  either 
pictorially  or  by  a  set  of  coordinates  (see  Figure 
8.1).   By  definition  Q   is  always  1. 

R.:   'rewriting  rules'  of  j    grammar  at  i    level. 

Consists  of  pairs  (r  .  T').   p  is  a  finite  connected 

P'   P    * 

subset  of  I  x  I  and  T     t    T '    are  mappings  from  p  into 
V..   Here  every  (k,  £ )  e  I  x  I  refers  to  a  unit  cell 
defined  by  Q  .   At  a  given  level  terminal  symbols 
are  never  rewritten. 

An  'initial  array'  A1  at  level  i  ,  is  a  mapping  from 
Q     (if  i  =  p,  the  highest  level,  it  is  a  mapping  from  I  x  I) 
onto  {#  ,  S  } .   The  initial  array  is  all  blanks  except  for  one  S  . 

Similarly  a  'terminal  array'  AT  at  level  i ,  is  a  mapping 
from  I  x  I  onto  (Z1,   ft1)  for  all  j  such  that  {(k,  £)|a£(1c,£  )  e 
£  .}  is  connected. 

As  mentioned  earlier  any  terminal  symbol  a    ,  at  level 
i+1  is  a  'sentence'  of  shape  Q    ,  derived  by  a  grammar  at  level 
i.   That  is  to  say,  every  a1    can  be  expanded  into  an  array  of 
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shape  Q1    consisting  of  only  terminal  symbols  of  i    level. 

This  can  be  expressed  as  A   — ^  a        ,  i.e. ,  the  'array' 
can  be  derived  from  the  initial  array  A   (of  shape  Q    ,  by 
definition)  with  the  application  of  rewriting  rules  of  j 
grammar  at  i    level.   We  can  derive  A   from  A    by  expanding 
each  and  every  terminal  symbol  in  it,  in  the  manner  described 
above . 


Shape 
Parameter 


Set  of 
Coordinates 


Template 


□ 


Q' 


(0,0),  (-1,0),  (-1,1),  (0,1) 

(0,0),  (0,-1) 

or 
(0,0),  (-1,-1) 

and  so  on. 


i     i 
i I i 

i 
i 

— ' 1 — | 

i 


Figure  8.1   The  'Shape'  Parameter  Q1  and 
Corresponding  Templates 
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The  language  of  MIAG  is  defined  as: 

L(MLAG)  =  {b|a  =»  B] 

A:   Initial  array  at  highest  level,  p 
B:   Terminal  array  at  lowest  level,  0 

The  terminal  array  at  level  0  is  sometimes  referred  to 
as  final  array. 

The  'sentence'  in  the  MIAG  is  generated  in  the  following 
manner: 

Ap  ^  ap     G?     ap-i       Ai    GJ    Ao 

s       T  n  T  9—      AT   —   *••  AT  .  .— -+       n  AT 
D-l/2...n   1  3=1,2. ,.n0 

Starting  with  the  initial  array  at  highest  level,  a 
terminal  array  is  generated  at  that  level.   Then  with  the  help 
of  grammars  at  next  lower  level,  each  'terminal'  is  replaced 
by  its  image  in  terms  of  terminal  symbols  defined  at  lower 
level.   This  is  analogous  to  laying  floor  'tiles'  on  the.  floor 
in  the  assigned  space.   This  process  is  carried  on  until  the 
'final  array'  is  derived  which  is  a  'sentence'  in  the  MIAG. 

The  following  examples  along  with  the  illustrations 
will  clarify  the  concepts  introduced  above. 

8.4.4   Examples  of  MIAG  Which  Generate  Texture  Scenes 

I.   Herringbone  pattern: 

In  order  to  demonstrate  the  simplicity  in  specifications 
of  an  MLAG  as  compared  to  conventional  array  grammar,  we 
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generate  the  same  scenes  as  mentioned  in  example  3  of  section  8.3 
MLAG  (of  order  1)  =  { G1 ,  G°) 

G1   =  {V1,    Z1,    Q1,    R1,    S1,    #*} 

V1   =    [S1,    tt1,    of1} 

1         r    li 

z     =   (a    J 


Q      = 


(1)      S" 


(4x3    template.       Can  also 
be   expressed   as   a    set   of 
coordinates ) 


a 


lUi 


1      1. 


(2)       [a^#x]  _^[ax    a]  ,    x  e  A 
.0 


and      a 


0      R 


^ 


and    (G°:         V° ,    E°f    Q°  ,    R° ,    S         #   } 


vu   =    (S,    #,    0,    1} 


zu   =    {0,1} 


Q°    =    1 


rs  #  #  #" 

#  #  #  # 

L#  #  #  #. 


=* 


0    0    10' 
0    10    1 
LI   0   0   0- 


[Note:       Small    unit   cells    can  be   directly   defined 
as    shown.      More   complex  cells   can   be 
derived  by   a   set   of   rules.] 
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Using  G  ,  the  initial  array  A_  at  level  1  is  filled  with 


or,       or   i 


the  terminal 

using  R   (Figure  8.2). 


s  then  expanded  into  terminals  at  level  0 


II.   Diamond  pattern: 

With  a  slight  modification,  we  can  generate  more  complex 
patterns .   We  can  introduce  two  terminals  at  level  1 ,  and  two 
grammars  at  level  0. 

G  :  same  as  in  the  previous  example  except  for  £   and  R 

Z1  =  (a1.  P1}- 


and 


R1:   (1)   S1  -  aM   P1 


(2) 

[°£  #*] 

-* 

[or   a  i 
x        J 

,    x 

=   L,    R 

(3) 

<  * 

— 

^   A 

,    x 

=   L,    R 

(4) 

[al  tt1] 

— 

[o£  P1] 

/    x 

=   U,    D 

(5) 

[pi  #'] 

— *> 

[£   a1] 

,    x 

=   U,    D 

With  these  rules  we  can  generate  alternating  rows  of  en's  and 

3's  in  A   (terminal  array  at  level  1). 

R0 

Oil 
where :  A       — ►    a 

s 

R0 

A  TV0  2  ol 

and  A      *      p 

s 


G   and  G?  are  same  as  G   in  previous  example  except: 


R°- 
R1. 


S    #  #  #" 
#  #  #  # 


0  0  10 

0  10  1 

1  0  0  0J 


109 


#' 


#' 


#' 


#' 


# 


#' 


#' 


a 


a 


a' 


a' 


a' 


a 


Initial   Array    at   Level    1 


a 


a' 


a' 


a' 


a't 


A°T 


Terminal  Array  at  Level  1  Final  Array 

(a)  Herringbone  Pattern 


a 


0' 


a 


0' 


cr' 


ft 


a' 


ef 


a 


a1t 


Terminal  Array  at  Level  1  Final  Array 

(b)   Diamond  Pattern   (Dark  Cell  =  1 

Light  Cell  =  0) 


Figure  8.2   Generation  of  Texture  Scenes  Using  MLAG 
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and 


R2: 


S  #  #  #1 
#  #  #  # 


ri  o 

0    0") 

0    1 

0    1 

Lo  o 

i  oJ 

Figure  8.2  shows  the  generation  of  the  diamond  pattern. 

In  these  examples  we  have  specified  the  'unit  cells' 
at  level  0  and  the  rules  of  placement  at  level  1.   Thus  MIAG 
is  really  suitable  for  generating  texture  scenes  that  can  be 
represented  by  unit  cell/placement  model.   We  can  also  generate 
unit  cells  consisting  of  statistical  textures  (as  described  in 
example  4,  section  8.3)  at  level  0  and  generate  'brickwall 
type'  textures  by  a  regular  arrangement  of  these  unit  cells 
at  level  1  and  so  on. 

8.4.5   Restrictions  on  the  'Shape'  of  the  Template 

To  avoid  the  complicated  problems  that  would  arise  in 
generating  a  meaningful  scene  with  MLAG,  we  find  it  necessary 
to  place  the  following  restrictions  on  the  'shape'  of  the 
'template'  at  every  level. 

a)  Every  term  in  the  vocabulary  of  all  grammars 
at  a  given  level  expands  into  a  pattern  in  the 
next  terminal  array  whose  size  and  shape  is 
fixed  as  defined  by  the  template  at  that  level. 

b)  In  order  to  ensure  that  there  are  no  'holes' 
generated  when  neighboring  terminals  are  expanded, 
we  need  to  have 

(i)   The  left  edge  of  a  template  should  be  the 

jig-saw-complement  (jsc)  of  its  own  right 
edge  and 
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(ii)   The  top  edge  of  the  template  should  be  'jsc' 
of  the  bottom  edge. 
These  restrictions  are  for  four  point  neighborhood  and  for 
other  neighborhoods,  these  are  suitably  modified. 

We  have  to  exercise  some  caution  while  selecting  some  com- 
plex shapes.   Unless  the  shape  selected  is  simple  like  rectangular 
we  may  need  to  specify  some  additional  rules  for  juxtaposing  the 
cells  of  this  shape  in  deriving  terminal  arrays  of  lower  level 
from  higher  level. 

8. 5   'Interval  Complexes'  and  Grammars 

One  of  the  basic  needs  in  the  'linguistic  approach'  to 
pattern  recognition  is  to  be  able  to  write  a  reasonably  simple 
grammar  by  analyzing  a  set  of  'sentences',  in  practical  cases. 
Without  this  capability  this  approach  is  of  limited  use.   Our 
concern  here  is  to  come  up  with  2-D  grammars  that  would  generate 
a  family  of  textures,  by  analyzing  them.   We  intend  to  show  with 
examples  that  the  'interval  complexes'  in  their  capability  as 
'texture  feature  detectors'  (section  4.3)  supply  sufficient 
information  to  specify  a  reasonably  simple  grammar. 

Example  1 : 

Let  us  first  consider  a  linear  case.   The  following 
'interval  complexes'  have  been  derived  for  linear  textures 
T   and  T   shown  in  Figure  4.1 

T  03233  _  130223  T  232303 

1    "      xl      X2   X3  2    "      Xl      X2      X3  3    "      Xl      X2      X3 

We  have  seen  that  L  ,  L   and  L   act  as  'filters'  which 
have  a  'passband'  for  'events'  (in  this  case  a  triplet  of 
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pixels)  from  T  .   We  can  easily  implement  the  characteristics 
of  these  filters  in  terms  of  rewriting  rules  of  a  grammar  and 
generate  only  those  triplets  which  fall  in  the  'passband*  of 
these  filters. 

Grammar  -  G  =  [V,  Z,  R,  s) 
Vocabulary  -  V  =  (S,  A,    B,  C,  D,  E,  F,  0,  1,  2,  3} 
Terminals  -    =  {0,  1,  2,  3} 

S  is  the  start  symbol 
R:   S  -  SS 
[SSSj  -*     [CF3]|[EBF]|[FPC] 

A  -»  0|l  D-  l|  2 
B  -A  |  2  E-  D|  3 
C  -*  B|3      F-  2|  3 

It  can  be  easily  seen  that  this  nondeterministic  context 

sensitive  language,  G  is  capable  of  generating  scenes  belonging 

to  T   family.   An  automaton  that  would  accept  the  language  of  G 

is  not  only  capable  of  recognizing  textures  in  family  T  ,  it  can 

also  discriminate  textures  in  T   from  those  in  T  .   This  latter 

property  is  attributed  to  the  nature  of  internal  complexes,  that 

they  resulted  from  comparing  a  pair  of  scenes  which  specify 

'passband1  and  'stopband'  of  events. 

We  should  be  careful  in  our  choice  of  T   (when  it  is 

not  specified  in  the  problem),  in  order  to  derive  interval 

complexes  that  would  extract  prominent  texture  features  in  T  . 

For  example,  if  T   is  a  structural  texture,  we  select  a  scene 

filled  with  random  noise  (random  texture)  to  be  T  .   The  interval 

complexes  derived  in  this  case,  hopefully,  tend  to  pick  up 

structural  features  which  make  T   different  from  the  random 
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texture.   We  performed  this  experiment  with  the  cheesecloth 
texture  (Figure  7.1)  using  the  template  shown  in  Figure  8.3  to 
extract  events.   The  interval  complexes  derived  are  shown  in 
Figure  8.3. 

As  before  we  can  consider  these  interval  complexes  as 
2-D  filters.   A  part  of  the  output  of  each  filter  with  the 
cheesecloth  texture  at  input  is  shown  in  Figures  8.4a  through 
8.4f.   Figure  8.4g  shows  the  union  of  the  output  of  all  six 
filters.   We  notice  that  Figure  8.4  accentuates  the  fact  that 
the  cheesecloth  texture  consists  of  many  similar  looking  patterns 
(events)  aligned  in  vertical  direction. 

With  the  help  of  these  interval  complexes  we  can  specify 
a  2-D  grammar  that  is  capable  of  generating  the  scenes  belonging 
to  the  family  of  cheesecloth-type  textures. 
MLAG  (of  order  1)  =  ( G1 ,  G°} 


G1  =  {V1,  Z1,  Q1,  R1,  S1,  #X] 
V1  =  {S1,  #\  a1} 


1    r  Xi 


Q1  = 


R1  = 


(1) 


a 


(2)  [a*  tt1]  _^[«^  a1] 

A    .0   R°  «l 

and  A   — ».  a 
s 


for  x  e  A 
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X3 

X4 

X5 

X2 

Xl 

X6 

x9 

X8 

X7 

Number  of  gray  levels  used  =  4,  i.e.,  0<  x .  <_  3 


23      13      13      23      13 
Ll:         x2         X3         X7 


x8         X9 


01  13  13  02  02  13 

xl  x2  X3  X4  X8  X9 

13  01  13  02  12  13      0    1 

xl  x2  X4  X5  X6  8           9 


L4: 


01      12      13      13      13      13      0.  2 


x2         X3         X5 


x6         X7         X8         X9 


13  13  01  01  01      12 

Xl  X4  X5  X6  X7         X8 

02  12  12  12  01 

xl  x5  X6  X7  8 


Figure  8.3   The  template  used  and  the  interval 
complexes  derived  for  cheesecloth 
texture  (T1)  x  random  texture  (T°) 


115 


••••   OUTPUT   OF 

FILTF.P 

• 

1   •••• 

• 

M 

• 

M 

• 

Ma 

* 

• 

• 

M 

• 

•M 

• 

• 

• 

M 

• 

M* 

t 

• 

M 

• 

Mt 

• 

• 

M 

• 

MC 

1 

M 

'• 

• 

M 

• 

Mt 

M 

• 

•' 

M 

• 

MM 

M 

• 

• 

M 

• 

•  MM 

1 

M 

• 

M 

MM 

• 

•  MM 

• 

M 

• 

M 

M 

M 

MMM 

• 

M 

( 

Mt 

M 

• 

MM     • 

• 

•( 

tl 

Mt 

M 

• 

MS 

• 

•M*  • 

M  t 

• 

MM 

M 

MM 

1  M 

M 

•  M* 

* 

• 

• 

• 

I* 

M* 

• 

M     Mt 

Mt  • 

• 

• 

It 

MM 

1 

M  M* 

M 

• 

t 

M* 

t 

•MM 

•  • 

M 

• 

MM 

t 

•  MM 

MM* 

Mil 

t 

M* 

M 

M* 

MM 

tltt 

t 

•  mi 

M( 

( 

1 

Mt 

t 

•     *M 

M* 

M 

MM 

t 

•     *M 

3  /  3/  3/ 
/\    / 0  / 0 

3~7  V7  V 
/2  /  0  /  0 
T7  *7  3/ 
/l    /  2   /  I 


M  tMI      •        M* 


FILTER   «  1 


• 

Mt* 

• 

Mt        t 

• 

tM 

• 

M  t 

• 

It* 

■ 

M      t 

■ 

•        •«• 

t 

tM   t 

•  t 

Mt 

t 

MMI 

Mt 

Mt 

MMM   t 

M 

MM 

*M  MM 

M 

t  M  MM 

t   1 

Mt      Mt 

M 

tM  MM 

tIM   tit 

• 

tMMM 

t 

III  MM 

M 

MMtM 

•II      Ml 

• 

MMttt 

•IM      tl 

• 

t  MMMt 

•mi  • 

M 

MMtMM 

•   M      II 

t 

IMtlMI 

• 

•IMI      1 

t 

t   MtMM 

t 

MM* 

t 

•MNHIH 

• 

Ml  I      1 

t 

IMtMMt 

• 

MMM 

IMItMMt 

t 

•      M  It 

t  t 

MltMIMI 

• 

1 

•M 

MMMtMt 

• 

■1      I 

(0) 


3  /   2  /   3/ 

/\    /O  /0 

T7\7  3/ 
/\  /o  /q 

T7z7  3/ 
/\  /o  /o 


FILTER  »2 


•  •••  OUTPUT  OF  FILTH  •    I  •••• 

•  M  Mil  It  *M*I  II  Mill 
I     I     Ml     II          IMII  II            III       It 

•  M  M  I  I  I  II  M  Mt  I  It  lit  I  I 
tIMIII  MM  Ml  t  II  III  U  I 
I  M     MM     t  t       It     M  Ml  II            III     It  t 

M     I  M     •  •          •     I     Mt  M     •  •            til     It  I 

II     tl       tl          II       It  Mil            lltlt 

■•••I*          *IM  ••                II     Ml 

Mill*          II     Mt  I                II     II  I 

Itltll          I      I       tl  I                It     It! 

Mill!          IIM  lltlt 

IMII       I  II       It          I  II          II  lilt 

■  Mil       tMI                t  I          ttltll 

•  Mill!  I  It  II  Ittll 
tl****  •  M  ■  It  I 
till  lltl  It!  lit 
llltt  •■•It  I*  a  a  « 
tilt  I  II  I  II  I  lilt 
lltlt  III  Ml  till 
I  II     II                              Itl  II                lilt 

•  Mil                                I      II  It      I                  till 
lllltl                              *M  (•                ••■* 

I   It      It             I           IIM  Mil          tltt 

•  I             II             I                  til  lllltl        t 

•  till                           IM  It      It          lilt 

HUH                     I*  *•(        a  a     a       a 

lltl                                I      It  II             IMtll 

tllltl                     IIM  II                It     It     I 

lllltl                           IM  Mil           Mtlll 

•  III*                         •••  ••••          tana 

lltlt                      IIM  It        I      tit  lit     t 

IIIIM          •             ••••  ••          I        IMI        It 

•  a  a  a  aa        •          till  M                til      II 

•  till          I          •••  ••                  •••• 

•••••          •          ••■  •          t        ititt 

lilt              I          til  attitlt 

•  till  tl  a  a  a  lit  titti 
till  iiiii  •  tut 
a  a  a  a  •  til  •  tun 
ttli              t          til  t                             ti  ti 

•  ■••                •            ••  •                       till! 

tilt          *          *  *          **ittt 

•  tit          t          tl  •          t                  ■•  ti 

•  II      I      I      lit  III        t         tilt 
till*          •(  itt        t         lltl 

•  ••••••••  •••            a     aa  aa 

lllltl*)  ••••               Mil 

I      lltlt      III  lit          itiat 

•  ••••      •      •••  ••■            ••••• 

•  ••••••••  ••••••! 

Ittttllll  ti            it    it 

•  til              •••••  ••                  •• 

••••              •••••  •••••            • 

•  •••              •          ••  •••••••• 

•  •          •••          ••  itititt 


(b) 


••••    OUTPUT    OF    FILTER 


I  I 

I  I 

I  • 

I  • 


•  • 

•  • 

•  • 


% 

/  0 

2  / 

3  / 

/  1 

FILTER   #3 


•  •  • 
t  •  • 
till 

•  •  •  • 
■  tit 

•  lit 

•  a  t  t 
tit 

•  I 
itt 

•  •  t  i 

•  ti 

•  it 
t      t  • 

t  t 
t  • 
t  • 
t  • 
t 
I  t 
t  • 

•  t 

•  t 

•  t 

•  t 


(c) 


OUTPUT    OF    f  UTt* 


2    / 

/  1 

1/ 

/I 

2  / 

3  / 

FILTER    *4 


I  • 
t  I 
t  I 
•  I 


•  t 
I  t  I 

•  tit 

•  l  •  I 


(d) 


Figure    8.4 


A   portion   of    the   output   of   the 
filters    1-4    (a-d)    with   cheesecloth 
texture    (Tl)    as   input. 
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Figure  8.4  (contd. ) 


A  portion  of  the  output  of  the 
filters  5,  6  (e,  f)  with  cheesecloth 
texture  Tl  as  input   .   Shows  the 
union  of  the  output  of  all  six  filters, 
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In  this  example  the  rewriting  rules  at  level  '0'  are 
written  in  such  a  way  that  every  event  generated  falls  in  the 
passband  of  one  of  six  filters  ('interval  complexes').   At 
level  1  we  specified  the  global  arrangements  of  these  events. 

Thus  we  have  shown  how  we  can  specify  grammars  that 
would  generate  textures  that  occur  in  practical  cases  with  the 
help  of  the  'interval  complexes'. 
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9.   SUMMARY  AND  CONCLUSIONS 

9. 1   Discussion  of  Results 

In  this  work  we  have  presented  methods  suitable  for 
computer  implementation  for  the  analysis  and  synthesis  of  visual 
texture. 

The  Decision  Theory  Method,  coupled  with  the  application 
of  interval  covering  theory  is  shown  capable  of  automatically 
generating  2-D  filters  which  act  as  texture  feature  detectors, 
from  the  analysis  of  input  scene.   We  have  demonstrated  that 
this  method  is  very  versatile  and  can  deal  with  the  various 
problems  concerning  visual  texture,  such  as  scene  segmentation 
using  textural  information,  extraction  of  texture  borders, 
discrimination/recognition  of  both  spatially  and  chromatically 
textured  scenes  and  so  on. 

The  time  series  model  provides  the  basis  for  a  method 
which  is  capable  of  synthesizing  natural  looking  textures. 
Unlike  many  earlier  methods,  this  one  can  derive  the  parameters 
needed  for  the  synthesis  automatically  from  the  analysis  of  parent 
texture.   Based  on  this  model  we  also  proposed  scheme  for 
redundancy  reduction  in  the  TV  transmission  of  a  digitized 
textural  scene. 

The  multilevel  array  grammars  introduced  are  shown 
capable  of  generating  brickwall-type  textures.   We  also 
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illustrated  a  way  of  specifying  these  grammars  for  real  textural 
scenes  with  the  help  of  interval  complexes  derived  from  the 
analysis  of  those  scenes. 

9. 2   Suggestions  for  Future  Research 

We  suggest  the  following  topics  for  further  investigation. 

(a)  By  virtue  of  the  present  interpretation  of  the  'event1 ,  the 
decision  theory  method  of  analysis  of  texture  is  based  on  the 
statistics  of  local  patterns  only.   It  is  possible  to  perform 
analysis  to  global  level  by  modifying  the  interpretation  of 
event.   Here  each  variable  in  the  event  is  allowed  to  represent, 
instead  of  gray  level  of  a  point  which  is  a  local  property,  some 
measure  of  a  global  property,  for  example,  number  of  edges  per 
unit  area,  gray  level  distributions,  spatial  frequency  content, 
etc.   These  measures  are  quantized  and  digitized.   Each  variable 
can  assume  different  range  of  values. 

When  a  'global  event'  is  defined  in  this  manner  we  can 
perform  analysis  of  the  scene  at  global  level.   The  'likelihood 
ratio'  criterion  provides  a  better  'similarity  criterion'  than  those 
found  in  other  methods  performing  similar  analysis  [3,  35,  53], 
There  is  a  need  for  a  scheme  that  would  suggest  minimum  number  of 
appropriate  global  properties  to  be  used  in  dealing  with  the  given 
set  of  texture  families.   Investigation  should  be  carried  in  this 
direction. 

(b)  In  the  time  series  analysis,  in  order  to  deal  with  multiple 
seasonalities  that  occur  commonly  in  practice,  we  need  efficient 
algorithms  and  faster  programs  for  identifying,  filtering  and 
checking  the  adequacy  of  a  time  series  model  to  represent  real 
textures. 
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(c)   The  complete  formulation  of  stochastic  turing  machines  and 
studies  of  their  properties  have  not  yet  been  successfully 
accomplished  even  in  linear  case  [16,  20].   The  studies  of  formal 
properties  of  languages  generated  by  stochastic  array  grammars 
and  multilevel  array  grammars  as  well  as  the  automata  that  would 
accept  these  languages  is  a  topic  that  is  to  be  given  considerable 
attention  in  the  future. 


121 


LIST  OF  REFERENCES 


[I]  Anderson,  T.  W.   An  Introduction  to  Multivariate  Statistical 

Analysis.   John  Wiley  &  Sons,  1958. 

[2]    Bacon,  D.  W.   "Seasonal  Time  Series,"  Ph.D.  Thesis, 
University  of  Wisconsin,  Madison,  1965. 

[3]   Bajcsy,  R.   "Computer  Identification  of  Textured  Visual 

Scenes,"  Report  CS-321,  Computer  Science  Department, 
Stanford  University,  Stanford,  1972. 

[4]    Bartels,  Peter  and  G.  L.  Wied.   "Tumor  Cell  Diagnosis  Based 

on  Stochastic  Properties  of  Digitized  Images,"  Proc.  2-D 
Dig.  Signal  Proc.  Conf . ,  Columbia,  Mo.,  1971. 

[51    Bhattacharya ,  P.  C.   "Order  of  Dependence  in  a  Normally 

Distributed  Two-Way  Series."   University  of  Arizona, 
1972  (unpublished  note). 

[6]    Box,  J.  E.  P.  and  G.  M.  Jenkins.   Time  Series  Analysis. 
Holden-Day,  Inc.,  1970. 

[7]    Brodatz,  P.   Textures.   New  York:   Dover  Publications,  1966. 

[8]   .   Wood  and  Woodgrains.   New  York:   Dover  Publications, 

1971. 

[9]    Carlucci ,  Luigia.   "A  Formal  System  for  Texture  Languages." 
Pattern  Recognition,  4  (1972),  53-72. 

[10]   Chow,  C.  K.   "An  Optimum  Character  Recognition  System  Using 
Decision  Functions."   IRE  Trans,  on  Electronic 
Computers ,  EC- 6  (December,  1957),  247-54. 

[II]  .   "A  Recognition  Method  Using  Neighbor  Dependance." 

IRE  Trans,  on  Electronic  Computers,  EC-11  (1962), 
683-90. 

[l2l   Conroy,  P.   Simulation  of  Texture  by  Computer  Graphics. 
TR-14.   Toronto:   Department  of  Computer  Science, 
University  of  Toronto,  1969. 

[13]   Darling,  E.  M.  and  R.  D.  Joseph.   "Pattern  Recognition  from 
Satellite  Altitudes. "   IEEE  Transcriptions,  SSC-4 
(1968),  38-47. 


122 

[l4l  Deutsch,  E.  S.  and  N.  J.  Belknap.   Texture  Descriptors 
Using  Neighborhood  Information.   TR-184.   College 
Park:   Computer  Science  Center,  University  of 
Maryland,  1972. 

[15I  Dodwell ,  P.  C.   Visual  Pattern  Recognition.   New  York: 
Holt,  Rinehart  and  Winston,  19  70. 

[l6l  Ellis,  C.  A.   "Probabilistic  Languages  and  Automata," 
DCS  Report  355,  Department  of  Computer  Science, 
University  of  Illinois,  Urbana,  Oct. ,1969. 

[l7]  Evans,  D.  M.  E. ,  ed.   Cytology  Automation.   Edinburgh  and 
London:   Livingstone,  1970. 

Cl8]  Flock,  H.  R.  and  A.  Moscatelli.   "Variables  of  Surface 
Texture  and  Accuracy  of  Space  Perceptions." 
Percept.  Mot.  Skills,  19  (1964),  327-34. 

[19] .   "Optical  Texture  and  Linear  Perspective  as  Stimuli 

for  Slant  Perception."   Psychology  Review,  72  (1965), 
505-16. 

[20]  Fu ,  K.  S.  and  T.  Huang.   "Stochastic  Grammars  and  Languages 
International  Journal  of  Computer  and  Information 
Sciences,  Vol.  1,  No.  2,  1972. 

[2l]  Gerdes ,  J.  W. ,  W.  B.  Floyd  and  G.  O.  Richards.   Automatic 
Target  Recognition  Device.   AD  478456,  January,  1966. 

[22]  Gibson,  J.  J.   "The  Reproduction  of  Visually  Perceived 
Forms."   Journal  of  Experimental  Psychology,  12 
(1929),  1-39. 

[23]  .   The  Perception  of  the  Visual  World.   Boston: 

Houghton  Mifflin,  1950. 

[24]  .   "The  Perception  of  Visual  Surfaces."   American 

Journal  of  Psychology,  63  (1950),  367-84. 

[25]  .   The  Senses  Considered  as  Perceptual  System. 

Boston:   Houghton  Mifflin,  1966. 

[26]  Goldstein,  A.  and  A.  Rosenfeld.   "Optical  Correlation  for 
Terrain  Type  Discrimination."   Photogram.  Eng. ,  -30 
(1964),  639-46. 

[27]  Grasselli ,  A.,  ed.   Automatic  Interpretation  and 

Classification  of  Images.   New  York:   Academic 
Press,  1969. 


123 


[28]  Green,  D.  M.  and  J.  A.  Swets.   Signal  Detection  Theory  and 
Psychophysics .   New  York:   John  Wiley  and  Son  Inc. , 
1966. 

[29]  Gruber,  H.  E.  and  W.  C.  Clark.   "Perception  of  Slanted 
Surfaces."   Percept.  Mpt.  Skills  Monogr.  Suppl.  2, 
6,  1956  (pp.  97-106). 

[30]  Grusser,  O.  J.  and  R.  Klinke,  eds.  Pattern  Recognition  in 
Biological  and  Technical  Systems.  Berlin:  Springer, 
1971. 

[31]  Hancock,  J.  C.  and  P.  A.  Wintz.   Signal  Detection  Theory. 
McGraw-Hill  Book  Co. ,  1966. 

[32]  Hanna ,  E.  J.  Multiple  Time  Series.  New  York:  John  Wiley 
and  Sons,  Inc.,  1970. 

[33]  Haralick,  R.  M.  and  J.  D.  Bissel.   Texture  Tone  Study  With 
Application  to  Digitized  Imagery.   (Computer  Abstracts 
AD-724117),  Kansas  University,  December,  1970. 

[34]  Hawkins,  J.  K.  and  G.  T.  Elerding.   "Image  Feature 

Extraction  for  Automatic  Terrain  Classification." 
Computerized  Imaging  Techniques,  VI  (1967),  1-8. 

[35J  .   "Textural  Properties  For  Pattern  Recognition." 

Picture  Processing  and  Psychopicturics.   Edited  by 
Lipkin  and  Rosenfeld.   New  York:   Academic  Press, 
1970. 

[36]  IEEE  Transactions  on  Computers,  July,  1972.   (Special  Issue 
on  Two-Dimensional  Digital  Signal  Processing. ) 

[37]  Julesz,  B.   "Visual  Pattern  Discrimination."   IRE 
Transactions ,  IT-8  (1962),  86-92. 

[38]  .   "Texture  and  Visual  Perception."   Scientific 

American,  (February,  1965). 

[39]  .   "Cluster  Formation  at  Various  Perceptural  Levels." 

Methodologies  of  Pattern  Recognition.   Edited  by 
W.  Walter  Dunn.   New  York:   Academic  Press,  1968. 

[40]  Kaizer.   "A  Quantification  of  Textures  on  Aerial  Photo- 
graphs."  Unpublished  M.S.  Thesis,  Boston  University, 
1955. 

[41]  Kaneff,  S. ,  ed.   Picture  Language  Machines.   London: 
Academic  Press,  1970. 


124 


[42]  Katz,  Y.  H.  and  W.  L.  Doyle.   "Automatic  Pattern  Recognitioi 
of  Meterological  Satellite  Cloud  Photography."   Memo 
RM-3412,  NASA,  Rand  Corp.,  Santa  Monica,  Calif.,  1966. 

[43J  Kirsch,  R.  A.   "Computer  Interpretation  of  English  Text 

and  Picture  Patterns."   IEEE  Transactions  on  Electronic 
Computers ,  August,  1964. 


[44]  Ledley,  R.  S.   "Texture  Problems  in  Biomedical  Pattern 

Recognition,"  Proceedings  of  the  1972  IEEE  Conference 
on  Decision  and  Control  and  11th  Symposium  in 
Adaptive  Process,  1972. 

[45J  Lipkin,  L.  E. ,  W.  C.  Watt  and  R.  A.  Kirsch.   "The  Analysis, 
and  Description  of  Biological  Images."   Annual  of  the 
New  York  Academy  of  Science,  128  (1966),  984-1012. 

[46]  Lipkin,  B.  S.  and  A.  Rosenfeld,  eds.   Picture  Processing  ant 
Psychopictorics .   New  York :   Academic  Press ,  New  York 
1970. 

[47]  McCormick,  B.  H.  and  S.  N.  Jayaramamurthy.   "Analysis  of 
Texture,"  DCS  Report  531,  Department  of  Computer 
Science,  University  of  Illinois,  Urbana,  July,  1972. 

[48]  and  S.  N.  Jayaramamurthy.   "Synthesis  of  Texture," 

DCS  Report  566,  Department  of  Computer  Science, 
University  of  Illinois,  Urbana,  July,  1973. 

[49]  Michalski ,  R.  S.  "A  Geometric  Model  for  the  Synthesis  of 
Interval  Covers ,  Report  461 ,  Department  of  Computer 
Science,  University  of  Illinois,  Urbana,  1971. 

[50]  and  B.  H.  McCormick.   "Interval  Generalization  of 

Switching  Theory. "   Proceedings  of  the  Third  Annual 
Houston  Conference  on  Comput.  Syst.  Sci. ,  Houston, 
Texas,  April,  1971.   (See  also  an  extended  version 
in  Report  No.  442,  Department  of  Computer  Science, 
University  of  Illinois,  Urbana,  1971.) 

[51]  Milgram,  D.  L.  and  A.  Rosenfeld.   Array  Automata  and 
Array  Grammars.   TR-70-141,  NONY-5144  (00),  Nov. 
1970,  Computer  Science  Center,  University  of 
Maryland,  Maryland. 

[52]  and  A.  Rosenfeld.   "Array  Automata  and  Array 

Grammars."   Proceedings  of  IFIP  '71  Congress, 
Yugoslavia,  1971. 


125 


[53]  Muerle,  J.  L.   "Some  Thoughts  On  Texture  Discrimination 

by  Computer."   Picture  Processing  and  Psychopictorics. 
Edited  by  Lipkin  and  Rosenfeld.   New  York:   Academic 
Press,  1970. 

[54]  Narasimhan,  R.   "Picture  Languages."   in  Picture  Language 
Machines.   Edited  by  Kaneff.   London:   Academic 
Press,  1970. 

[55]   Pfaltz,  J.  L.   Web  Grammars  and  Picture  Description. 
TR- 70-138,  GJ-754,  Computer  Science  Center, 
University  of  Maryland,  Maryland,  Sept. ,  1970. 

[56]   Pickett,  R.  M.   "The  Perception  of  a  Visual  Texture." 

Journal  of  Experimental  Psychology,  68  (1964),  13-20. 

[57]  .   "Response  Latency  In  a  Pattern  Perception 

Situation."   acta  Psychologica ,  27  (1967),  160-69. 

[58]  .   "The  Perception  of  Random  Visual  Texture." 

Models  for  the  Perception  of  Speech  and  Visual  Form. 
Edited  by  W.  Walter  Dunn.   Cambridge:   M.  I.  T. 
Press,  1967. 

[59]  .   Perceiving  Visual  Texture:   A  Literature  Survey. 

Aerospace  Medical  Research  Lab,  TR-68-12  (1968). 

[60]  .   "Visual  Analyses  of  Texture  in  the  Detection 

and  Recognition  of  Objects."   Picture  Processing 

and  Psychopictorics.   Edited  by  Lipkin  and  Rosenfeld. 

New  York  and  London:   Academic  Press,  1970. 

[61]  .   Application  of  Texture  Perception  In  the  Analysis 

of  Complex  Optical  Imagery.   Aerospace  Medical 
Research  Lab,  TR-71-81  (1971). 

[62J  Prewitt  ,  J.  M.  S.  and  M.  L.  Mendelsohn.   "The  Analysis  of 
Cell  Images."   Annual  of  the  New  York  Academcy  of 
Science,  128  (1966),  1035-53. 

[6  3]   Puzin,  M.   "Simulation  of  Cellular  Patterns  by  Computer 
Graphics."   Unpublished  M.Sc.  Thesis,  University 
of  Toronto,  1969. 

[64]  Read,  J.  S.  and  S.  N.  Jayaramamurthy.   "Automatic  Generation 
of  Texture  Feature  Detectors."   IEEE  Transactions  on 
Computers  (July,  1972). 

[65]  Robinson,  E.  A.   Multichannel  Time  Series  Analysis  with 

Digital  Computer  Programs.   San  Francisco:   Holden-Day 
Publications,  1967. 


126 

[66]  Rosenfeld,  A.  "Automatic  Recognition  of  Basic  Terrain 
Types  from  Aerial  Photographs."  Photogram.  Eng. , 
28  (1962),  115-32. 

[67]   .   "On  Models  For  the  Perception  of  Visual  Texture." 

Models  for  the  Perception  of  Speech  and  Logical  Form. 
Edited  by  Walter  Dunn.   Cambridge:   M.I.T.  Press, 
1967. 

[68]   .   "Automated  Picture  Interpretation."   Land 

Evaluation.   Macmillan  of  Australia  (1968),  187-99. 

[69]   .   "a  Report  on  the  Symposium  on  Automatic  Photo 

Interpretation."   Annual  of  the  New  York  Academy  of 
Sciences,  157  (1969) ,  60-64. 

[70]   .   Picture  Processing  by  Computer.   New  York: 

Academic  Press,  1969. 

[71]   ,  Y.  H.  Lee  and  R.  B.  Thomas.   "Edge  and  Curve 

Detection  For  Texture  Discrimination."   Picture 
Processing  and  Psychopictorics.   Edited  by  Lipkin 
and  Rosenfeld.   New  York:   Academic  Press,  1970. 

[72]   and  B.  S.  Lipkin.   "Texture  Synthesis."   Picture 

Processing  and  Psychopictorics.   Edited  by  Lipkin 
and  Rosenfeld.   New  York:   Academic  Press,  1970. 

[73]         .   isotonic  Grammars.  Parallel  Grammars,  and  Picture 


l "-  **—  ^    — ^»-.."w-^  ~  , 


Grammars.   TR-70-111,  NONY-5166(00) ,  Computer  Science 
Center,  University  of  Maryland,  Maryland,  April,  1970. 

174]  and  E.  B.  Troy.   Visual  Texture  Analysis.   (Computer 

Abstracts,  TR  70-116),  Computer  Science  Center, 
University  of  Maryland,  Maryland,  1970. 

[75]   and  M.  Thurston.   "Edge  and  Curve  Detection  for 

Visual  Scene  Analysis."   IEEE' Transactions  on 
Computers  (May,  1971). 

[76]   f  m.  Thurston,  and  Y.  H.  Lee.   "Texture  Edge,  Spot 

and  Streak  Detection."   Proceedings  of  Two-Dimensional 
Digital  Signal  Processing  Conference.   Columbia,  Mo., 
1971. 

[77]   and  D.  L.  Milgram.   Array  Automata  and  Array 

Grammars — 2.   TR-171,  NONY-5144 (00 ) ,  Computer  Science 
Center,  University  of  Maryland,  Maryland,  September, 
1971. 

[78]   .   "Progress  in  Picture  Processing:   1969-1971." 

Computing  Surveys,  5,  1973. 


127 

[79]  .   "Picture  Processing:   1972."   Computer  Graphics 

and  Image  Processing,  December,  1972. 

feo]   Smith,  P.  and  O.  W.  Smith.   "Veridical  Perceptions  of 

Cylindricality :   a  Problem  of  Depth  Discrimination 
and  Object  Identification."   J.  Exp.  Psychology, 
pp.  145-156,  1962. 

[81]   Smith,  A.  R.  III.   "Two-Dimensional  Formal  Languages  and 
Pattern  Recognition  by  Cellular  Automata."   Proc.  12 
SWAT,  1971  IEEE  Conference  (Switching  and  Automatic 
Theory) . 

[82]   Special  Issue  on  "Redundancy  Reduction"  -  Proceedings  of 
IEEE. 

[83]   Special  Issue  on  "Syntactic  Pattern  Recognition"  (Parts  1 
and  2).   Pattern  Recognition,  3,  1971,  and  4,  1972. 

[84]   Stoloff,  P.  H.   "Detection  and  Scaling  of  Statistical 
Differences  Between  Visual  Textures."   Perception 
and  PsychoPhysics ,  6  (1969),  333-36. 

[85]   Strong,  J.  P.  III.   Automatic  Cloud  Cover  Mapping.   TR-163/ 
July,  1971,  University  of  Maryland  Computer  Science 
Center,  College  Park,  Maryland. 

[86]   Sutton,  R.  N.  and  E.  L.  Hall.   "Texture  Measures  for 
Automatic  Machine  Recognition  and  Classification 
of  Pulmonary  Disease."   Proceedings  of  Two-Dimensional 
Digital  Signal  Processing  Conference,  Columbia,  Mo., 
1971. 

[87]   Swanlund,  G.  D.   "Design  Requirements  for  Texture  Measure- 
ments."  Proceedings  of  Two-Dimensional  Digital  Signal 
Processing  Conference.   Columbia,  Mo.,  1971. 

[88]   Swets ,  J.  A.   "Effectiveness  of  Information  Retrieval 
Methods."   Scientific  Report  No.  8,  Air  Force 
Cambridge  Research  Laboratories,  USAF,  Bedford, 
Mass.,  June,  1967. 

[89]   Trout   H-  R*  G«   "The  Description  of  Texture."   File  No. 
832,  Department  of  Computer  Science,  University  of 
Illinois,  Urbana,  1970. 

[90]   Troy,  E.  B. ,  E.  S.  Deutsch  and  A.  Rosenfeld.   Visual 

Texture  Analysis,  3  TR-145,  Computer  Science  Center, 
University  of  Maryland,  Maryland,  Feb. ,  1971. 

[91]   Two-Dimensional  Digital  Signal  Processing  Conference. 
Proceedings.   Columbia,  Mo.,  October,  1971. 


128 

[92]   Watanabe,  S. ,  ed.   Methodologies  of  Pattern  Recognition. 
New  York:   Academic  Press,  1969. 

[93]   .   Knowing  and  Guessing.   New  York:   John  Wiley  and 

Sons,  Inc. ,  1969. 

[94]   Wied,  G.  L.  and  G.  F.  Bahr ,  eds.   Automated  Cell  Identifi- 
cation and  Cell  Sorting.   New  York :   Academic  Press , 
=  1970. 

[95]   Young,  I.  T.   "Automated  Leukocyte  Recognition." 

Automated  Cell  Identification  and  Cell  Sorting. 
Edited  by  Wied,  G.  L. ,  Bahr,  G.  F.   New  York: 
Academic  Press,  1970. 

[96]   Zusne ,  L.   Visual  Perception  of  Form.   New  York:   Academic 
Press,  1970. 


129 


VITA 


Sadali  Narasappa  Jayaramamurthy  was  born  in  Anantapur, 
Andhra  Pradesh  (India),  on  July  15,  1946.   He  received  the 
Bachelor's  degree  in  Electronics  and  Communications  from 
Andhra  University,  in  1967.   He  was  given  a  special  award  by 
the  Institution  of  Engineers  (India)  for  obtaining  highest 
percentage  of  marks  among  the  graduating  students  of  all 
disciplines  from  Andhra  University  in  1967.   He  obtained 
M.Tech.  degree  in  Electrical  Engineering  from  the  Indian 
Institute  of  Technology,  Kanpur  (India)  in  1969. 

He  joined  the  University  of  Illinois ,  Urbana  as  a 
graduate  research  assistant  in  the  Department  of  Computer 
Science  in  1969.   While  associating  with  the  Illinois  Pattern 
Recognition  Computer  Project  (ILLIAC  III),  he  conducted  research 
under  the  guidance  of  Professor  Bruce  H.  McCormick.   He  is  the 
coauthor  with  John  S.  Read  of  a  paper  entitled,  "Automatic 
Generation  of  Texture  Feature  Detectors"  which  was  published 
in  IEEE  Transactions  on  Computers,  July  1972.   He  is  also  a 
coauthor  with  Professor  Bruce  H.  McCormick  of  the  DCS  Technical 
Reports  entitled,  "Analysis  of  Texture"  (July  1972)  and 
"Synthesis  of  Texture"  (July  1973).   These  publications  evolved 
from  his  thesis  research. 

Mr.  Jayaramamurthy  is  a  student  member  of  Institute  of 
Electrical  and  Electronic  Engineers. 


JOGRAPHIC  DATA 
ET 


1.   Report  No. 

UTUCDCS-R-73-601 


3.  Recipient's  Accession  No. 


tie  and  Subtitle 

Computer  Methods  for  Analysis  and 
Synthesis  of  Visual  Texture 


5.  Report  Date 

September  1973 


6. 


jthor(s ) 


Sadali  N.   Jayaramamurthy 


8.   Performing  Organization  Rept. 
No. 


rforming  Organization  Name  and  Address 

Department  of  Computer  Science 
University  of  Illinois 
Urbana,  Illinois 


10.  Project/Task/Work  Unit  No. 

US  AEC  AT(ll-l)21l8 


11.  Contract /Grant  No. 

k6 -26 -15-303 


ponsoring  Organization  Name  and  Address 

US  AEC  Chicago  Operations  Office 
98OO  South  Cass  Avenue 
Argonne,  Illinois  60^39 


13.  Type  of  Report  &  Period 
Covered 


14. 


upplementary  Notes 


Abstracts  Computer  methods  are  presented  which  deal  with  the  problems  of  visual  texture, 
cifically  Texture  Analysis  and  Texture  Synthesis. 

The  Decision  Theory  Method,  as  its  name  indicates  is  based  on  the  principles  of 
tistical  decision  theory.   This  method  in  conjunction  with  the  Internal  Covering 
ory,  automatically  generates  a  set  of  interval  complexes  which  act  as  2-D  filters 
t  detect  texture  features  in  the  scene  of  analysis.  We  demonstrate  the  versatility 
this  method  to  deal  with  various  problems  of  visual  texture,  such  as,  scene 
mentation  using  textural  information,  extraction  of  texture  borders,  discrimination/ 
ognition  of  both  spatially  and  chromatically  textured  scenes,  etc. 

We  propose  a  model  that  views  the  pixels  of  a  digitized  textural  scene  as  a  two-way 
sonal  time  series.   Based  on  this  model,  we  develop  a  method  for  synthesis  of 
ural  looking  textures.   This  method  possesses  a  desirable  quality  that  the 


ameters  needed  for  the  synthesis  are  derived  from  the  analysis  of  'parent'  texture, 
.,  the  texture  to  be  imitated. 

Extending  the  concepts  of  two-dimensional  formal  grammars,  known  as  array  grammars, 
introduce  'multilevel  array  grammars'.   These  are  shown  capable  of  generating 
plex  texture  scenes,  specifically  'brickwall-type'  texture,  that  is  those  textures 
ch  are  perceived  at  many  levels  and  at  each  level,  they  can  be  either  structural 
statistical.  We  also  indicate  a  way  of  specifying  these  grammars  for  texture 
nes  in  real  cases,  with  the  help  of  'interval  complexes'. 

Finally  we  demonstrate  the  methods  we  suggested  act  to  complement  each  other 
ling  with  the  various  problems  of  textured  scenes  occurring  in  practice,. 

Key  Words 

texture  analysis,  texture  synthesis,  visual  texture,  texture  likelihood  ratio, 
operative  characteristic  curve,  statistical  decision  theory,  seasonal  time 
series,  autoregressive  terms,  moving  average  terms,  array  grammars 


COSATI   Field/Group 


Availability  Statement 


«   NTIS-38   (10-70) 


19.  Security  Class  (This 
Report) 

UNCLASSIFIED 


20.  Security  Class  (This 

Page 
UNCLASSIFIED 


21.   No.  of  Pages 


22.   Price 


USCOMM-DC    40329-P7I 


)rm  AEC-427 

(6/68) 
AECM  3201 


U.S.  ATOMIC  ENERGY  COMMISSION 

UNIVERSITY-TYPE  CONTRACTOR'S  RECOMMENDATION  FOR 

DISPOSITION  OF  SCIENTIFIC  AND  TECHNICAL  DOCUMENT 

( See  Instructions  on  Reverse  Side ) 


AEC  REPORT  NO. 


C00-2118-001+8 


2.    TITLE 

Computer  Methods  for  Analysis  and  Synthesis 
of  Visual  Texture 


TYPE  OF  DOCUMENT    (Check  one): 

(3  a.  Scientific  and  technical  report 

Q3  b.  Conference  paper  not  to  be  published  in  a  journal: 

Title  of  conference 

Date  of  conference 


Exact  location  of  conference. 

Sponsoring  organization 

□  c.  Other  (Specify) 


RECOMMENDED  ANNOUNCEMENT  AND  DISTRIBUTION    (Check  one): 

P3  a.  AEC's  normal  announcement  and  distribution  procedures  may  be  followed. 

~2  b.  Make  available  only  within  AEC  and  to  AEC  contractors  and  other  U.S.  Government  agencies  and  their  contractors. 
]]  c.  Make  no  announcement  or  distrubution. 

REASON   FOR    RECOMMENDED    RESTRICTIONS: 


SUBMITTED  BY:     NAME   AND  POSITION    (Please  print  or  type) 

Sadali  N.  Jayaramamurthy 
Research  Assistant 


Organization 


Department  of  Computer  Science 
University  of  Illinois 


Urbana^   Illinois  6l801 


Signature 


^fW#^*^r<v 


^\ 


7 


Date 


FOR   AEC   USE   ONLY 

AEC  CONTRACT  ADMINISTRATOR'S  COMMENTS,   IF    ANY,  ON    ABOVE    ANNOUNCEMENT  AND   DISTRIBUTION 
RECOMMENDATION: 


PATENT  CLEARANCE: 

LJ  a.  AEC  patent  clearance  has  been  granted  by  responsible  AEC  patent  group. 
U  b.   Report  has  been  sent  to  responsible  AEC  patent  group  for  clearance. 
LJ  c.  Patent  clearance  not  required. 


h\<^ 


V* 


s 


^ 


<Q 


UNIVERSITY  OF  ILLINOI9-URB ANA 


3  0112  047417826 


